-- Logs begin at Wed 2022-10-19 12:47:18 UTC, end at Wed 2022-10-19 13:39:02 UTC. -- Oct 19 13:10:09.942409 dv-cinder-861883-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 19 13:10:09.949921 dv-cinder-861883-1-smb devstack@keystone.service[81336]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 13:10:09 2022] *** Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: nodename: dv-cinder-861883-1-smb Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: machine: x86_64 Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: clock source: unix Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: pcre jit disabled Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: detected number of CPU cores: 4 Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: current working directory: / Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: detected binary path: /usr/bin/uwsgi-core Oct 19 13:10:09.953024 dv-cinder-861883-1-smb devstack@keystone.service[81336]: your processes number limit is 47680 Oct 19 13:10:09.953624 dv-cinder-861883-1-smb devstack@keystone.service[81336]: your memory page size is 4096 bytes Oct 19 13:10:09.953624 dv-cinder-861883-1-smb devstack@keystone.service[81336]: detected max file descriptor number: 2048 Oct 19 13:10:09.953624 dv-cinder-861883-1-smb devstack@keystone.service[81336]: lock engine: pthread robust mutexes Oct 19 13:10:09.953624 dv-cinder-861883-1-smb devstack@keystone.service[81336]: thunder lock: enabled Oct 19 13:10:09.953624 dv-cinder-861883-1-smb devstack@keystone.service[81336]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 19 13:10:09.953624 dv-cinder-861883-1-smb devstack@keystone.service[81336]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 13:10:09.992311 dv-cinder-861883-1-smb devstack@keystone.service[81336]: Python main interpreter initialized at 0x561f8c4159c0 Oct 19 13:10:09.992311 dv-cinder-861883-1-smb devstack@keystone.service[81336]: python threads support enabled Oct 19 13:10:09.992311 dv-cinder-861883-1-smb devstack@keystone.service[81336]: your server socket listen backlog is limited to 100 connections Oct 19 13:10:09.992311 dv-cinder-861883-1-smb devstack@keystone.service[81336]: your mercy for graceful operations on workers is 90 seconds Oct 19 13:10:09.992654 dv-cinder-861883-1-smb devstack@keystone.service[81336]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 13:10:09.992748 dv-cinder-861883-1-smb devstack@keystone.service[81336]: *** Operational MODE: preforking *** Oct 19 13:10:09.992993 dv-cinder-861883-1-smb devstack@keystone.service[81336]: *** uWSGI is running in multiple interpreter mode *** Oct 19 13:10:09.992993 dv-cinder-861883-1-smb devstack@keystone.service[81336]: spawned uWSGI master process (pid: 81336) Oct 19 13:10:09.993190 dv-cinder-861883-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 19 13:10:09.995582 dv-cinder-861883-1-smb devstack@keystone.service[81336]: spawned uWSGI worker 1 (pid: 81347, cores: 1) Oct 19 13:10:09.995582 dv-cinder-861883-1-smb devstack@keystone.service[81336]: spawned uWSGI worker 2 (pid: 81348, cores: 1) Oct 19 13:10:09.995582 dv-cinder-861883-1-smb devstack@keystone.service[81336]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 13:10:14.274873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:10:14.274873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: from cryptography.utils import int_from_bytes Oct 19 13:10:14.275630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:10:14.275630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: from cryptography.utils import int_from_bytes Oct 19 13:10:14.275776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:10:14.275776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: from cryptography.utils import int_from_bytes Oct 19 13:10:14.275776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:10:14.275776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: from cryptography.utils import int_from_bytes Oct 19 13:10:14.325487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:10:14.325682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:10:14.325879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] command line args: [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:10:14.326031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:10:14.326155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:10:14.326237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:10:14.326941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ================================================================================ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:10:14.327040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] command line args: [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:10:14.327227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] admin_token = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.327316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:10:14.327424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ================================================================================ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:10:14.327505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config_dir = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.327657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.327741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] admin_token = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.327841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] config_source = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.327926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config_dir = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.328025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] debug = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.328106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.328227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.328727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] config_source = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.328727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] debug = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.328850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.328920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329520 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_config_append = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.329928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_config_append = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_dir = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_dir = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.330981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.331970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.332136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.332271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.332399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.332526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.332650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.332775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.332894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333256 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.333863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] publish_errors = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] publish_errors = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.334810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] standard_threads = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.335933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] standard_threads = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_journal = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.336963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_json = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_journal = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_stderr = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_json = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] use_syslog = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_stderr = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] use_syslog = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.337870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:10:14.338089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.338206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.338331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.338458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.338577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.338577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.338797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.338797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.339964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.340939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341305 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341785 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.341903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.342950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.343965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.344923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.345902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.346982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.347141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.347263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.347413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.347534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.347657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.347780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.347910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.348935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.349910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.350027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.350141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.350378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.350647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.350849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.351116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.351441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.351739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.351930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.352392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.353299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.353401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.353499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.353596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.353709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.353810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.353917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.354919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.355804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.356997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.357116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.357234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.357341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.357983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.358952 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.359927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.360905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.361944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.362924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363339 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.363941 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.external = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364434 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.364931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.password = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] auth.token = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.365959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.366937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.external = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.367056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.367226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.367359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.367516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.367641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.367761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.367880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.password = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] auth.token = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368497 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.368990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.369117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.369282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.369403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.369511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.369637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.369764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.369885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370004 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370491 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.370968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.371982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.372997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.373268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.373922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.374921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.375926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.376962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.377991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.378963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.379828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.380916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.381985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.382964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.383957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.384932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.385914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386880 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.386999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.387187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.387311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.387431 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.387550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.387714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.387838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.387965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388090 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.388966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.389913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.390885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391379 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.391991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.392955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.393931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394765 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.394891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395561 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395800 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.395919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396168 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.396895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.397900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.398994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.399979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.400098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.400217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.400441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.400593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.400717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.400836 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.400955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401561 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.401929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.402903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.403910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.404908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.405997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.406965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.407992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408354 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.408962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.409938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.410905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.411948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.412920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.413904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.414890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.415975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.416937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.417186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.418181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.418181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.418181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.418181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:10:14.418181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:10:14.442554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.442739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.442969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.444495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.444737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.444972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.451444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.453324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.479159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.479391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.481062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.481302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.533126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.533809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.582427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.582661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.582947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.583216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.739997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.740896 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.741031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.741124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.741265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.763815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.763992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764078 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.764995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.765126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.765209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.765341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.776264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.776540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.789344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.789589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.789770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.789869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.790893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.791145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 19 13:10:14.808875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.809091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 13:10:14.809215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.809688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 13:10:14.809776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.809890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 13:10:14.810043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.810168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.810252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 19 13:10:14.810440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.810521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.810728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.810813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.810989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.811071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.811324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.820733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.821016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.821100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.821287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.821369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.821573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.821664 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.821915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.828662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.829208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.831629 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.831921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.832209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.832293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.832498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.832578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.832786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.832874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.833960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.834157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.834245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.834427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.834508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.834707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.834983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.858467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.859185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.859987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.860276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.860692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.860986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.865024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.865316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.865602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.865725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.866017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.866306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.872070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.872363 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.872806 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.873102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.878109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.878411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.878706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.878887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.879001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.879214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.879312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.879508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.879591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.879798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.879880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.880082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.880165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.880371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.880648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.880924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.895870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.896155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.896849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.897135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.900162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.901053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.903475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.903781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.904320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.905147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.908600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.909389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.911940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.912547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.915240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.915550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.915787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.915872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.916117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.916411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.916548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.916709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.916795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.917006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.917297 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.917586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.933333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.933628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.933899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.934168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.934249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.934778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.935056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.935355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.941402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.942362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.942967 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.943979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.944549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.944841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.945536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.945822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.947547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.947839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.948126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.948410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.948640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.948812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.948933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.949227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.949520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.949924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.960183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.960472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.960754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.961034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.961351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.961443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.961646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.961730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.961937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.962021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.962227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.962614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.962901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.963213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.978202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.979422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.981197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.982395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.984690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.985913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.986188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.987452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.987710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.987999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.988403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.988946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.989237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.989641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.994898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.996239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.996361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.997724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:14.999349 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:14.999751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.000040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.000325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.000721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.001127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.001423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.001711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.008275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:15.008571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.008858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.009691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:15.009990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.010281 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.015915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:15.016206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.016489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.016768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.017045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.017320 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.017403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 19 13:10:15.017605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.017704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.017883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.017966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.018164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.018247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.018447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.018540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.018730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.018813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.019017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.019121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.019324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.019406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.019600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.019728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.019883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.020179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.020457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.020740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.021026 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 19 13:10:15.054933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f8c4159c0 pid: 81347 (default app) Oct 19 13:10:15.056717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f8c4159c0 pid: 81348 (default app) Oct 19 13:10:15.058244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2d5bb-8321-4758-96c2-74361f669c5d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:15.058539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2d5bb-8321-4758-96c2-74361f669c5d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:15.058815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2d5bb-8321-4758-96c2-74361f669c5d None None] PATH_INFO: `/v3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:15.063331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Wed Oct 19 13:10:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:21.780520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620fca9-98b2-455b-835c-7857873cd265 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:21.781032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620fca9-98b2-455b-835c-7857873cd265 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:21.781140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620fca9-98b2-455b-835c-7857873cd265 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:21.785328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:10:21.790595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:21.791161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:21.791161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:21.862680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: INFO dbcounter [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] Registered counter for database keystone Oct 19 13:10:21.881610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG oslo_db.sqlalchemy.engines [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:10:21.887788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writer thread running {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:10:22.066135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG passlib.handlers.bcrypt [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81347) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 13:10:22.066435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG passlib.handlers.bcrypt [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81347) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 13:10:22.123911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:22.125518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:22.251818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 13:10:22.699635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620fca9-98b2-455b-835c-7857873cd265 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:22.768603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: INFO dbcounter [None req-1620fca9-98b2-455b-835c-7857873cd265 None None] Registered counter for database keystone Oct 19 13:10:22.789344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG oslo_db.sqlalchemy.engines [None req-1620fca9-98b2-455b-835c-7857873cd265 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:10:22.795433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writer thread running {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:10:22.913827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620fca9-98b2-455b-835c-7857873cd265 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:22.918043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd21b5c-2924-48a0-a899-4ad92a761455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:22.918672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21b5c-2924-48a0-a899-4ad92a761455 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:22.918953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21b5c-2924-48a0-a899-4ad92a761455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:22.919254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21b5c-2924-48a0-a899-4ad92a761455 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:22.927906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd21b5c-2924-48a0-a899-4ad92a761455 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:22.979727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cbd21b5c-2924-48a0-a899-4ad92a761455 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 13:10:22.980019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd21b5c-2924-48a0-a899-4ad92a761455 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:22.989714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Oct 19 13:10:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:10:22.995636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:23.012119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c78ea-8683-41e2-964d-d8ce16521156 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:23.016510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be0236-f876-4f70-8418-47738a8d87a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:23.017607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be0236-f876-4f70-8418-47738a8d87a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:23.017889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be0236-f876-4f70-8418-47738a8d87a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:23.018159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be0236-f876-4f70-8418-47738a8d87a4 admin admin] PATH_INFO: `/v3/projects/efe3aef313a94867b11cab52bd11b924` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:23.019765 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be0236-f876-4f70-8418-47738a8d87a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=efe3aef313a94867b11cab52bd11b924)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:23.074309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING keystone.common.rbac_enforcer.enforcer [None req-96be0236-f876-4f70-8418-47738a8d87a4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 19 13:10:23.074665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be0236-f876-4f70-8418-47738a8d87a4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:23.079225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Oct 19 13:10:22 2022] GET /identity/v3/projects/efe3aef313a94867b11cab52bd11b924 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:25.177538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098281c-d3ba-4dc7-8657-8b14e7db1d0c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:25.178052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098281c-d3ba-4dc7-8657-8b14e7db1d0c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:25.178052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098281c-d3ba-4dc7-8657-8b14e7db1d0c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:25.182185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:25.188417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca38de-2ff6-489e-b7e4-1a32317a7f9c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:25.188810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca38de-2ff6-489e-b7e4-1a32317a7f9c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:25.188966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca38de-2ff6-489e-b7e4-1a32317a7f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:25.209276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-55ca38de-2ff6-489e-b7e4-1a32317a7f9c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:25.210791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-55ca38de-2ff6-489e-b7e4-1a32317a7f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:25.218631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 19 13:10:25.479682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098281c-d3ba-4dc7-8657-8b14e7db1d0c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:25.491484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098281c-d3ba-4dc7-8657-8b14e7db1d0c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:25.495605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0a75a-1b19-4038-a86b-eff113e842be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:25.496196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0a75a-1b19-4038-a86b-eff113e842be admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:25.496476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0a75a-1b19-4038-a86b-eff113e842be admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:25.496747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0a75a-1b19-4038-a86b-eff113e842be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:25.504719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0a75a-1b19-4038-a86b-eff113e842be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:25.506489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0a75a-1b19-4038-a86b-eff113e842be admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:25.515511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Oct 19 13:10:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:10:25.520600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca38de-2ff6-489e-b7e4-1a32317a7f9c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:25.529827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca38de-2ff6-489e-b7e4-1a32317a7f9c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:25.534250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc40a67-e18e-41b9-8340-6c00dc4ff4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:25.534874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40a67-e18e-41b9-8340-6c00dc4ff4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:25.535200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40a67-e18e-41b9-8340-6c00dc4ff4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:25.535481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40a67-e18e-41b9-8340-6c00dc4ff4b2 admin admin] PATH_INFO: `/v3/users/84e8dce821b046efa98901e318ae5922` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:25.536796 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc40a67-e18e-41b9-8340-6c00dc4ff4b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=84e8dce821b046efa98901e318ae5922)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:25.538623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc40a67-e18e-41b9-8340-6c00dc4ff4b2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:25.540169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Wed Oct 19 13:10:25 2022] GET /identity/v3/users/84e8dce821b046efa98901e318ae5922 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:27.722594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668fe41-a526-4bdd-91ad-3afafa5c872c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:27.723214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668fe41-a526-4bdd-91ad-3afafa5c872c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:27.723214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668fe41-a526-4bdd-91ad-3afafa5c872c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:27.724507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:27.729668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2bd6d-c0ae-48e5-a8c7-761d370053f4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:27.730109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2bd6d-c0ae-48e5-a8c7-761d370053f4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:27.730232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2bd6d-c0ae-48e5-a8c7-761d370053f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:27.748642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0ab2bd6d-c0ae-48e5-a8c7-761d370053f4 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:27.749875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0ab2bd6d-c0ae-48e5-a8c7-761d370053f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:27.772791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57fd8-7605-4075-a6ec-b51227df94e5 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:27.773073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57fd8-7605-4075-a6ec-b51227df94e5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:27.773350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57fd8-7605-4075-a6ec-b51227df94e5 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:27.774665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:10:27.779751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:27.780037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:27.780839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:27.822478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG passlib.handlers.bcrypt [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81348) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 19 13:10:27.822853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG passlib.handlers.bcrypt [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81348) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 19 13:10:27.832757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:10:27.872252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:27.873826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:27.972931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:10:28.103815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2bd6d-c0ae-48e5-a8c7-761d370053f4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.128994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:28.210934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2bd6d-c0ae-48e5-a8c7-761d370053f4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.236558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.244867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.245510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.245794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.246072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.257880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:28.267286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:28.268222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:28.269073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:28.271442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:28.274077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.337130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f313c-ff76-4133-9505-ae54d7b0d776 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.339380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:28.354255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:28.372568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab3574-770c-4bdf-875b-e178f979ed50 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.374611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.375513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.375799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.376076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.377048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:28.378491 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:28.389438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.sql.core [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 13:10:28.389438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 13:10:28.389438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [parameters: {'id': '06f52792539e4ff89b2b4d5e0cc974b0', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 13:10:28.389438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 13:10:28.406637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.407337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.407620 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.407895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:10:28.408224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 13:10:28.409208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application yield resource Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise self.value Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application session.commit() Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 13:10:28.410364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.flush() Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application compat.raise_( Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 13:10:28.411384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 13:10:28.413325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:10:28.415504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [parameters: {'id': '06f52792539e4ff89b2b4d5e0cc974b0', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 13:10:28.416975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:28.417984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 13:10:28.419252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.420327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:28.420327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:28.420593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 8/15] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Oct 19 13:10:28 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:10:28.420743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:28.420833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.422280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 8/16] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:28.427798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.515959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51711409-af22-46e1-965b-b9bad95880f7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.529240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24fced-79dc-4806-99ca-b37060a79af2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.548577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.549434 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.549720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.549999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.563043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.563691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.563970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.564243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] PATH_INFO: `/v3/users/84e8dce821b046efa98901e318ae5922` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.565379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] RBAC: Authorizing `identity:get_user(user_id=84e8dce821b046efa98901e318ae5922)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:28.566840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:28.568068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:28.568418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:28 2022] GET /identity/v3/users/84e8dce821b046efa98901e318ae5922 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:28.569676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:28.573817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:10:28.586869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:28.587973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:10:28.593659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:10:28.593659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:10:28.593659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:28.593659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:10:28.593933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:28.594020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.615515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:28.679578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc1a6c-60c8-4c13-90fd-917ec2522d69 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.698423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1d9c-a87b-4a84-a11c-ee48eb965537 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.713849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.714488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.714795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.715055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.716222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:28.717738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:28.719889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:28.725809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:28.736166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24623303-b1cc-4eca-9227-92844994456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.736852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623303-b1cc-4eca-9227-92844994456d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.737195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623303-b1cc-4eca-9227-92844994456d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.737471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623303-b1cc-4eca-9227-92844994456d None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.738231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24623303-b1cc-4eca-9227-92844994456d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:28.738528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24623303-b1cc-4eca-9227-92844994456d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:28.739938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24623303-b1cc-4eca-9227-92844994456d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:28.757103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:28.809359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:28.830814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21097be-b943-4832-93fa-a43f4ac793ab None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:28.866068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2c6b2-87d8-4d7f-9bad-141c22446dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:28.866755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c6b2-87d8-4d7f-9bad-141c22446dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:28.867038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c6b2-87d8-4d7f-9bad-141c22446dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:28.867344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2c6b2-87d8-4d7f-9bad-141c22446dc2 None admin] PATH_INFO: `/v3/domains/default/users/84e8dce821b046efa98901e318ae5922/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:28.869361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2c6b2-87d8-4d7f-9bad-141c22446dc2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=84e8dce821b046efa98901e318ae5922, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:28.870861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2c6b2-87d8-4d7f-9bad-141c22446dc2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:28.987595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 11/21] 10.222.0.46 () {58 vars in 1361 bytes} [Wed Oct 19 13:10:28 2022] PUT /identity/v3/domains/default/users/84e8dce821b046efa98901e318ae5922/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:10:31.299266 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8b06-2b09-47d1-b6dc-619408b41837 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:31.299765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8b06-2b09-47d1-b6dc-619408b41837 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:31.299885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8b06-2b09-47d1-b6dc-619408b41837 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:31.301283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:31.313730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb750c-dfef-48cf-b610-aac3579dea8c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:31.314622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb750c-dfef-48cf-b610-aac3579dea8c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:31.315178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb750c-dfef-48cf-b610-aac3579dea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:31.337319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f5fb750c-dfef-48cf-b610-aac3579dea8c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:31.339187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f5fb750c-dfef-48cf-b610-aac3579dea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:31.433511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:10:31.721133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80a55-7cde-447f-80e4-d780e4dd6bdf None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:31.721772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80a55-7cde-447f-80e4-d780e4dd6bdf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:31.722269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80a55-7cde-447f-80e4-d780e4dd6bdf None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:31.724245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:31.730281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504ce2-d8fb-4982-a730-2b252a5e8a66 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:31.730573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504ce2-d8fb-4982-a730-2b252a5e8a66 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:31.730857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504ce2-d8fb-4982-a730-2b252a5e8a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:31.755286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f6504ce2-d8fb-4982-a730-2b252a5e8a66 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:31.756492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f6504ce2-d8fb-4982-a730-2b252a5e8a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:31.846672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:31.851985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:31.923631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e50706-1f1d-4ba9-a639-869a16546632 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:31.923954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e50706-1f1d-4ba9-a639-869a16546632 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:31.924187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e50706-1f1d-4ba9-a639-869a16546632 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:31.925962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 13/26] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:31.932025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e8fb-9ad9-431a-bcbc-a674959e994a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:31.932325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e8fb-9ad9-431a-bcbc-a674959e994a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:31.932602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e8fb-9ad9-431a-bcbc-a674959e994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:31.955317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e50706-1f1d-4ba9-a639-869a16546632 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:31.975250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2bd8e8fb-9ad9-431a-bcbc-a674959e994a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:31.975431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2bd8e8fb-9ad9-431a-bcbc-a674959e994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:32.128451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 14/27] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:32.128775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:32.132455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84df3f1-4cb6-4332-a1f0-775c5845b24c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.133895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84df3f1-4cb6-4332-a1f0-775c5845b24c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.133895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84df3f1-4cb6-4332-a1f0-775c5845b24c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.145158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 15/28] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:32 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:32.150444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8075976-8df0-4ced-bf64-d6e2637838e9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.150788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8075976-8df0-4ced-bf64-d6e2637838e9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.151137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8075976-8df0-4ced-bf64-d6e2637838e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.175128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e50706-1f1d-4ba9-a639-869a16546632 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:32.189091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d8075976-8df0-4ced-bf64-d6e2637838e9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:32.192128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d8075976-8df0-4ced-bf64-d6e2637838e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:32.231188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:32.231754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.232194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.232475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.246135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:32.247719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:10:32.275608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:32.276505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:10:32.277294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:10:32.277294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:10:32.277294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:32.277294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 14/29] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:10:32.279115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:32.384055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 16/30] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:10:32.387062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8075976-8df0-4ced-bf64-d6e2637838e9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:32.477799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441ea0-ac20-4f10-be5f-9a54ed49a37b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:32.493434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:32.509539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:32.514687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:32.516938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.517226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.517577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.530320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:32.537752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:32.538819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:32.539833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:32.541119 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 15/31] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:10:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:32.545384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8075976-8df0-4ced-bf64-d6e2637838e9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:32.546607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:32.588273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ecefa-f027-477c-b607-b3f61e3be950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:32.588633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ecefa-f027-477c-b607-b3f61e3be950 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.588993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ecefa-f027-477c-b607-b3f61e3be950 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.589344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ecefa-f027-477c-b607-b3f61e3be950 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.590131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ecefa-f027-477c-b607-b3f61e3be950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:32.590518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ecefa-f027-477c-b607-b3f61e3be950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:32.592260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ecefa-f027-477c-b607-b3f61e3be950 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:32.612953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 17/32] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:32.617421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c3d9a-301e-441b-b800-13f39db13aa8 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.617421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c3d9a-301e-441b-b800-13f39db13aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.617421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c3d9a-301e-441b-b800-13f39db13aa8 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.617421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 18/33] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:32.617421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c3d9a-301e-441b-b800-13f39db13aa8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:32.672129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68d16e-69fb-49a9-bb70-dd0a205ebd21 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:32.714322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f631-d2a2-4301-9892-6401ee2b944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:32.715635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f631-d2a2-4301-9892-6401ee2b944e None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.716325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f631-d2a2-4301-9892-6401ee2b944e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.716757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f631-d2a2-4301-9892-6401ee2b944e None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.717731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f631-d2a2-4301-9892-6401ee2b944e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:32.720453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f631-d2a2-4301-9892-6401ee2b944e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:32.728365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c3d9a-301e-441b-b800-13f39db13aa8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:32.750609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:32.765214 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:32.765835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.766119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.766399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.767087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:32.767408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:32.768811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:32.777342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 19/34] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:32.779412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:32.852886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 16/35] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Oct 19 13:10:32 2022] POST /identity/v3/roles => generated 219 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:32.854386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41211de-149f-47e0-aa22-f2aa53e6318e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:32.854681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41211de-149f-47e0-aa22-f2aa53e6318e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:32.854966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41211de-149f-47e0-aa22-f2aa53e6318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:32.880618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c41211de-149f-47e0-aa22-f2aa53e6318e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:32.882613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c41211de-149f-47e0-aa22-f2aa53e6318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:32.897874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912aa0-8d50-4c6e-9564-d59b7cbd1d45 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:32.942788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:32.969150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 17/36] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:32.970475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41211de-149f-47e0-aa22-f2aa53e6318e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:33.089292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41211de-149f-47e0-aa22-f2aa53e6318e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:33.095876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:33.096519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.096806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.097087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.097784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:33.100763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:33.130742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9bec5-6475-4e79-ba92-dbecee7c69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:33.131971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bec5-6475-4e79-ba92-dbecee7c69ea None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.132600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bec5-6475-4e79-ba92-dbecee7c69ea None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.133025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bec5-6475-4e79-ba92-dbecee7c69ea None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.133847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9bec5-6475-4e79-ba92-dbecee7c69ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:33.134634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 20/37] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:10:32 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:33.135705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9bec5-6475-4e79-ba92-dbecee7c69ea None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:33.136764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:33.169199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 18/38] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Oct 19 13:10:32 2022] POST /identity/v3/roles => generated 225 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:33.215546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:33.228343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06371ca-2ed8-410c-91be-99eaabf3c45c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.228657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06371ca-2ed8-410c-91be-99eaabf3c45c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.228914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06371ca-2ed8-410c-91be-99eaabf3c45c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.230310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 19/39] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:10:33.242217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5c27-5d17-4e0c-aa13-1505805ceabe None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.242217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5c27-5d17-4e0c-aa13-1505805ceabe None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.242217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5c27-5d17-4e0c-aa13-1505805ceabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.267955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-93cd5c27-5d17-4e0c-aa13-1505805ceabe None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:33.270024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-93cd5c27-5d17-4e0c-aa13-1505805ceabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:33.343927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176a4a2-4473-431c-90e4-aa19269b6d1f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:33.346652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:33.394688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 20/40] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:33.395965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:33.396644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.396935 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.397282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] PATH_INFO: `/v3/users/84e8dce821b046efa98901e318ae5922` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.398487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] RBAC: Authorizing `identity:get_user(user_id=84e8dce821b046efa98901e318ae5922)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:33.398760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5c27-5d17-4e0c-aa13-1505805ceabe None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:33.400003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:33.403165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 21/41] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:33 2022] GET /identity/v3/users/84e8dce821b046efa98901e318ae5922 => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:33.409864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:33.536006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5c27-5d17-4e0c-aa13-1505805ceabe None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:33.538613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b84265-6af0-4e81-b254-a7763d83ab2f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:33.542951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:33.578557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:33.579208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.579498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.579780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.580722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:33.580909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:33.581691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.582159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.582373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:33.582831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.583723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:33.584285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 22/42] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:33.585736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:33.590000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:33.601290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 21/43] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Oct 19 13:10:33 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:33.682448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:33.716605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e15fe-411d-4bcb-95ab-af2670202689 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:33.717976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:33.757790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:33.758732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.759231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.759515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.760263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.domain.id=default, user.id=84e8dce821b046efa98901e318ae5922) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:33.760579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:33.762170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:33.775502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 23/44] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Oct 19 13:10:33 2022] GET /identity/v3/role_assignments?user.id=84e8dce821b046efa98901e318ae5922&scope.domain.id=default&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 530 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:33.805901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e593e40-f6b3-4ff4-9246-e7ebfc8a58d9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:33.845802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b2862-7445-462a-a345-3dc04829e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:33.846463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2862-7445-462a-a345-3dc04829e028 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:33.846744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2862-7445-462a-a345-3dc04829e028 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:33.847025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2862-7445-462a-a345-3dc04829e028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:33.848243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b2862-7445-462a-a345-3dc04829e028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:33.849735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b2862-7445-462a-a345-3dc04829e028 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:33.851697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 22/45] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:33.857300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:33.895421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:33.965635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174705ba-66bf-4aa6-98a3-a4b465759ee1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:34.000405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fa9e4-f26c-402f-8735-63a929e2c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:34.001105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa9e4-f26c-402f-8735-63a929e2c743 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:34.001393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa9e4-f26c-402f-8735-63a929e2c743 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:34.001675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fa9e4-f26c-402f-8735-63a929e2c743 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:34.002343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fa9e4-f26c-402f-8735-63a929e2c743 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:34.003951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fa9e4-f26c-402f-8735-63a929e2c743 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:34.030018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:10:33 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:36.154873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc17c3-0627-4a45-8323-68324ba707ab None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:36.155440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc17c3-0627-4a45-8323-68324ba707ab None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:36.155440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc17c3-0627-4a45-8323-68324ba707ab None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:36.156842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:36.162118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19242-1d34-4cc7-8545-116981b12ca9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:36.162546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19242-1d34-4cc7-8545-116981b12ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:36.162669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19242-1d34-4cc7-8545-116981b12ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:36.180852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1cd19242-1d34-4cc7-8545-116981b12ca9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:36.182047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1cd19242-1d34-4cc7-8545-116981b12ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:36.246265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:36.514156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc17c3-0627-4a45-8323-68324ba707ab None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:36.609568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:36.613719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc17c3-0627-4a45-8323-68324ba707ab None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:36.645199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d3a79-972e-49ce-997d-4fb96f1bb0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:36.645818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3a79-972e-49ce-997d-4fb96f1bb0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:36.646102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3a79-972e-49ce-997d-4fb96f1bb0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:36.646383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3a79-972e-49ce-997d-4fb96f1bb0d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:36.647526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d3a79-972e-49ce-997d-4fb96f1bb0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:36.648975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d3a79-972e-49ce-997d-4fb96f1bb0d3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:36.650513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 24/49] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:36.656624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19242-1d34-4cc7-8545-116981b12ca9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:36.673961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:36.752652 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19242-1d34-4cc7-8545-116981b12ca9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:36.790399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b83cb-9892-435e-af81-a66d4c1ffafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:36.790955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b83cb-9892-435e-af81-a66d4c1ffafa None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:36.791269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b83cb-9892-435e-af81-a66d4c1ffafa None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:36.791568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b83cb-9892-435e-af81-a66d4c1ffafa None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:36.792234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b83cb-9892-435e-af81-a66d4c1ffafa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:36.793698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b83cb-9892-435e-af81-a66d4c1ffafa None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:36.820834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Oct 19 13:10:36 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:10:38.949625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f948-fbe9-4744-8d55-786bfeb27d02 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:38.950141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f948-fbe9-4744-8d55-786bfeb27d02 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:38.950230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f948-fbe9-4744-8d55-786bfeb27d02 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:38.951570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 25/51] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:38.956863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fd2c5-6557-46d5-8561-f165ed8c5d6d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:38.957274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fd2c5-6557-46d5-8561-f165ed8c5d6d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:38.957429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fd2c5-6557-46d5-8561-f165ed8c5d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:38.975958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-975fd2c5-6557-46d5-8561-f165ed8c5d6d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:38.977190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-975fd2c5-6557-46d5-8561-f165ed8c5d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:39.037946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:39.044260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 27/52] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:39.315877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f948-fbe9-4744-8d55-786bfeb27d02 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:39.413248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f948-fbe9-4744-8d55-786bfeb27d02 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:39.445214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895a861-2436-4c8e-9f86-ad4bbaa176eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:39.445825 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895a861-2436-4c8e-9f86-ad4bbaa176eb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:39.446108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895a861-2436-4c8e-9f86-ad4bbaa176eb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:39.446383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895a861-2436-4c8e-9f86-ad4bbaa176eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:39.447525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895a861-2436-4c8e-9f86-ad4bbaa176eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:39.448958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895a861-2436-4c8e-9f86-ad4bbaa176eb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:39.450481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:39.456422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fd2c5-6557-46d5-8561-f165ed8c5d6d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:39.551761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fd2c5-6557-46d5-8561-f165ed8c5d6d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:39.585410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872f41f-dd54-4345-9fe8-d7f93a0cdefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:39.586013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f41f-dd54-4345-9fe8-d7f93a0cdefc None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:39.586298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f41f-dd54-4345-9fe8-d7f93a0cdefc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:39.586576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f41f-dd54-4345-9fe8-d7f93a0cdefc None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:39.587270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872f41f-dd54-4345-9fe8-d7f93a0cdefc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:39.588734 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872f41f-dd54-4345-9fe8-d7f93a0cdefc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:39.614942 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 28/54] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:10:39 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:42.720140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd0004-7553-4ac1-b7cd-7e26383dea23 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:42.720650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd0004-7553-4ac1-b7cd-7e26383dea23 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:42.720756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd0004-7553-4ac1-b7cd-7e26383dea23 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:42.722036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 27/55] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:42.727294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eca1d9-1f85-4673-b7f2-8b2b54c63605 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:42.728088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eca1d9-1f85-4673-b7f2-8b2b54c63605 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:42.728510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eca1d9-1f85-4673-b7f2-8b2b54c63605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:42.756176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-16eca1d9-1f85-4673-b7f2-8b2b54c63605 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:42.757680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-16eca1d9-1f85-4673-b7f2-8b2b54c63605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:42.824587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:42.846041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 29/56] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:43.008087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78a27-f165-4b65-adcf-cebba6e80be4 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.008708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78a27-f165-4b65-adcf-cebba6e80be4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.009184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78a27-f165-4b65-adcf-cebba6e80be4 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.010757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 28/57] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:43.016484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b3f8b-2a83-43f8-bdc1-25a943fbf9dc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.016989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b3f8b-2a83-43f8-bdc1-25a943fbf9dc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.017462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b3f8b-2a83-43f8-bdc1-25a943fbf9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.044343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3d1b3f8b-2a83-43f8-bdc1-25a943fbf9dc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:43.045860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3d1b3f8b-2a83-43f8-bdc1-25a943fbf9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:43.138608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 30/58] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:43.140040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78a27-f165-4b65-adcf-cebba6e80be4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:43.194874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:43.273283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78a27-f165-4b65-adcf-cebba6e80be4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:43.309020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e5340-9964-48dc-85dd-045c5ca7c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:43.309702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e5340-9964-48dc-85dd-045c5ca7c595 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.309984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e5340-9964-48dc-85dd-045c5ca7c595 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.310260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e5340-9964-48dc-85dd-045c5ca7c595 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.322458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e5340-9964-48dc-85dd-045c5ca7c595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-aa3e5340-9964-48dc-85dd-045c5ca7c595 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:43.327524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:43.329010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:43.329760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:43.335299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b3f8b-2a83-43f8-bdc1-25a943fbf9dc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:43.365131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f01b9-e5ea-466c-afe2-398e3faf9059 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.365447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f01b9-e5ea-466c-afe2-398e3faf9059 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.365684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f01b9-e5ea-466c-afe2-398e3faf9059 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.367177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 30/60] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:10:43.372813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fc6cb-9829-4cf4-9357-2e01ca980b03 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.373100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fc6cb-9829-4cf4-9357-2e01ca980b03 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.373375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fc6cb-9829-4cf4-9357-2e01ca980b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.397019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-335fc6cb-9829-4cf4-9357-2e01ca980b03 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:43.398292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-335fc6cb-9829-4cf4-9357-2e01ca980b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:43.483106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 31/61] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:43.483106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f9db-7ccc-41f2-a32e-a3ab9af47758 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.483106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f9db-7ccc-41f2-a32e-a3ab9af47758 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.483106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f9db-7ccc-41f2-a32e-a3ab9af47758 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.483106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 32/62] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:43.495312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753a6d4-d9e6-4b93-94a9-f304a0e7485f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.495669 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753a6d4-d9e6-4b93-94a9-f304a0e7485f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.495876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753a6d4-d9e6-4b93-94a9-f304a0e7485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.508913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b3f8b-2a83-43f8-bdc1-25a943fbf9dc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:43.517277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b753a6d4-d9e6-4b93-94a9-f304a0e7485f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:43.518468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b753a6d4-d9e6-4b93-94a9-f304a0e7485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:43.524589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:43.540084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:43.548896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:43.549841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.550132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.550414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.551584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:43.551910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:43.553838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:43.564439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 31/63] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:10:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:43.566039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:43.593401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 33/64] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:43.595270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753a6d4-d9e6-4b93-94a9-f304a0e7485f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:43.720366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793f71-bb31-4e38-b4f2-c46bfd20b9d6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:43.737767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753a6d4-d9e6-4b93-94a9-f304a0e7485f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:43.759738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ef32-6159-4923-a53d-e71cbfff4df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:43.760456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ef32-6159-4923-a53d-e71cbfff4df1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.760804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ef32-6159-4923-a53d-e71cbfff4df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.761245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ef32-6159-4923-a53d-e71cbfff4df1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.777425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:43.777575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ef32-6159-4923-a53d-e71cbfff4df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:43.778585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.779094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.779580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] PATH_INFO: `/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5525ef32-6159-4923-a53d-e71cbfff4df1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:43.784825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:43.785662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:43.786424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 32/65] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:43.787596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2404e67-671d-4f6b-9e36-6ed226871b10 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.787803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2404e67-671d-4f6b-9e36-6ed226871b10 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.788080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2404e67-671d-4f6b-9e36-6ed226871b10 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.789911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 33/66] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:43.790591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2404e67-671d-4f6b-9e36-6ed226871b10 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:43.830353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:43.902710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2404e67-671d-4f6b-9e36-6ed226871b10 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:43.905166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] RBAC: Authorizing `identity:get_user(user_id=2a4d5aeb2b594f3aa580d835f5be6f43)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:43.907284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:43.909122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 34/67] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:43 2022] GET /identity/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:43.913073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:43.928970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:43.939719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5027e4f-d5f6-4ce6-94b5-2a9abc710f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:43.940360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5027e4f-d5f6-4ce6-94b5-2a9abc710f8d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.940633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5027e4f-d5f6-4ce6-94b5-2a9abc710f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.940907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5027e4f-d5f6-4ce6-94b5-2a9abc710f8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.950701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5027e4f-d5f6-4ce6-94b5-2a9abc710f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-a5027e4f-d5f6-4ce6-94b5-2a9abc710f8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:43.956080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:43.956972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:43.957758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:43.962543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 34/68] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:10:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:43.963707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e6f33-b96c-478a-a3b8-4c22ac0f0b6b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:43.963989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e6f33-b96c-478a-a3b8-4c22ac0f0b6b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:43.964270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e6f33-b96c-478a-a3b8-4c22ac0f0b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:43.981259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-994e6f33-b96c-478a-a3b8-4c22ac0f0b6b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:43.982444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-994e6f33-b96c-478a-a3b8-4c22ac0f0b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:44.012408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b6c16-67e9-423d-8e83-52c7a13b529d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.045686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.046232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.046517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.046796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.047369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 35/69] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:44.047502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:44.047805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.048203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e6f33-b96c-478a-a3b8-4c22ac0f0b6b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.049271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.060973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 35/70] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.062217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.087461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.144110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.165612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e6f33-b96c-478a-a3b8-4c22ac0f0b6b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.172040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31acce3-0de0-4473-8de1-2771163313b5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.205568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.206209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.206491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.206771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.207904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.208895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.209347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.209534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.209821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.210103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.215662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.215662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.226646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:44.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:44.232373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:44.233141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 36/72] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:44.235357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.311004 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.317695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419b90-b993-4fd4-9ae4-2a5d9d30eee0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.343520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f42c-11c7-4316-9c36-80b7fd28f387 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.351432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.352049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.352333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.352617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.353285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:44.353594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.354983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.362823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 37/73] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.363543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.382421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.383051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.383360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.383635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] PATH_INFO: `/v3/users/84e8dce821b046efa98901e318ae5922` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.384770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] RBAC: Authorizing `identity:get_user(user_id=84e8dce821b046efa98901e318ae5922)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.386225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.387835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 37/74] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/users/84e8dce821b046efa98901e318ae5922 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.388604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.392899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.460806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c188cd-1428-4d1f-9341-43e1ad956f9e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.488965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f999de-22a6-4286-9dc1-666d7994f100 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.494155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.494826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.495138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.495423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371/users/2a4d5aeb2b594f3aa580d835f5be6f43/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.497350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] RBAC: Authorizing `identity:create_grant(project_id=8571e31058db4740b3a460a83172d371, user_id=2a4d5aeb2b594f3aa580d835f5be6f43, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.498820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.511168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 38/75] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:44 2022] PUT /identity/v3/projects/8571e31058db4740b3a460a83172d371/users/2a4d5aeb2b594f3aa580d835f5be6f43/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:10:44.511963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.523619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.524367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.524643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.524972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.525660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:44.525964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.527622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.538105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 38/76] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.539390 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.545837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.617771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.643731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585966f-94ff-4d33-bde6-ce6dca004c9f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.658167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a92d14-9e2f-4fb4-868b-bfe4331d8cc1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.681987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.682791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.683099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.683700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.685083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.686554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.689518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 39/77] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.690294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.700526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.701166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.701454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.701732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] PATH_INFO: `/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.702898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4d5aeb2b594f3aa580d835f5be6f43)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.704452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.706043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 39/78] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.706884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.788435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.806549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52830d-08f3-4ba3-8402-a5cd0907ce1f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.812867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e49a-00bf-456c-837d-5788f3bacce6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.842427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.843254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.843553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.844365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.845482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.846831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.846945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.847577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.847861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.848145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] PATH_INFO: `/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.848880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 40/79] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.849330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.851816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4d5aeb2b594f3aa580d835f5be6f43)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:44.853586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:44.855228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 40/80] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:44.860347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:44.860347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:44.960092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b3b5-9357-4061-a124-9f752873512f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.961137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40296d4-ef49-481a-ab12-ade32243cb86 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:44.997135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.997722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:44.997837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.998101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.998360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:44.998475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.998632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:44.998904 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:44.999059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:45.000115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:45.000658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:45.001572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:45.003212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 41/81] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:44 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:45.003947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:45.035117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 41/82] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:10:44 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:45.035117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:45.052307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:45.097460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:45.146434 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a49a-16a0-4878-ad07-2be7f4c84284 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:45.170675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17640c33-410d-4ddd-810a-9bb0a66e863c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:45.192653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:45.193422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:45.193807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:45.194187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371/users/84e8dce821b046efa98901e318ae5922/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:45.196366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] RBAC: Authorizing `identity:create_grant(project_id=8571e31058db4740b3a460a83172d371, user_id=84e8dce821b046efa98901e318ae5922, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:45.198069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:45.216667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:45.217246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:45.217575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:45.217859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] PATH_INFO: `/v3/projects/1513bf7ba820425fbfc366d85afe8f34` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:45.219698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] RBAC: Authorizing `identity:get_project(project_id=1513bf7ba820425fbfc366d85afe8f34)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:45.219927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 42/83] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:45 2022] PUT /identity/v3/projects/8571e31058db4740b3a460a83172d371/users/84e8dce821b046efa98901e318ae5922/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:10:45.220744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:45.221360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:45.223360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 42/84] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:45 2022] GET /identity/v3/projects/1513bf7ba820425fbfc366d85afe8f34 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:45.229176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:45.335814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:45.364609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56a863-5b4c-41e1-aea4-5f94fa17a32a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:45.392141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2484b6-bf2f-46b3-a4d7-bcceef1f5030 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:45.402288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:45.410551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6815f-dd97-4450-907a-ab408bceab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:45.411746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6815f-dd97-4450-907a-ab408bceab72 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:45.412042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6815f-dd97-4450-907a-ab408bceab72 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:45.412324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6815f-dd97-4450-907a-ab408bceab72 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371/users/2a4d5aeb2b594f3aa580d835f5be6f43/roles/c2a5de5e2b0745e89cd777db9a2d1099` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:45.415470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6815f-dd97-4450-907a-ab408bceab72 None admin] RBAC: Authorizing `identity:create_grant(project_id=8571e31058db4740b3a460a83172d371, user_id=2a4d5aeb2b594f3aa580d835f5be6f43, role_id=c2a5de5e2b0745e89cd777db9a2d1099)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:45.417703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6815f-dd97-4450-907a-ab408bceab72 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:45.437174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 43/85] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:45 2022] PUT /identity/v3/projects/8571e31058db4740b3a460a83172d371/users/2a4d5aeb2b594f3aa580d835f5be6f43/roles/c2a5de5e2b0745e89cd777db9a2d1099 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:10:45.450522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf0067-153f-47aa-8746-287f90dae48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:45.451262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0067-153f-47aa-8746-287f90dae48b None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:45.451537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0067-153f-47aa-8746-287f90dae48b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:45.451815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0067-153f-47aa-8746-287f90dae48b None admin] PATH_INFO: `/v3/projects/1513bf7ba820425fbfc366d85afe8f34/users/2a4d5aeb2b594f3aa580d835f5be6f43/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:45.454444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf0067-153f-47aa-8746-287f90dae48b None admin] RBAC: Authorizing `identity:create_grant(project_id=1513bf7ba820425fbfc366d85afe8f34, user_id=2a4d5aeb2b594f3aa580d835f5be6f43, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:45.456037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf0067-153f-47aa-8746-287f90dae48b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:45.473425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 43/86] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:45 2022] PUT /identity/v3/projects/1513bf7ba820425fbfc366d85afe8f34/users/2a4d5aeb2b594f3aa580d835f5be6f43/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:10:47.268180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354acca-c291-49db-9b7f-28fdb9ba939d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:47.268679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354acca-c291-49db-9b7f-28fdb9ba939d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:47.268751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354acca-c291-49db-9b7f-28fdb9ba939d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:47.270322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 44/87] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:47.285061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada4091-2cfc-48fd-9b7d-a851e202ad5b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:47.285917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada4091-2cfc-48fd-9b7d-a851e202ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:47.286388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada4091-2cfc-48fd-9b7d-a851e202ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:47.315823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9ada4091-2cfc-48fd-9b7d-a851e202ad5b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:47.317342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9ada4091-2cfc-48fd-9b7d-a851e202ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:47.403059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 44/88] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:47.939873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354acca-c291-49db-9b7f-28fdb9ba939d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:48.065189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354acca-c291-49db-9b7f-28fdb9ba939d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:48.107428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04a865-4502-4f89-8d2a-6f912760e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:48.108067 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04a865-4502-4f89-8d2a-6f912760e9af None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.108344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04a865-4502-4f89-8d2a-6f912760e9af None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.108669 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04a865-4502-4f89-8d2a-6f912760e9af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.122599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04a865-4502-4f89-8d2a-6f912760e9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-4d04a865-4502-4f89-8d2a-6f912760e9af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:48.127892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:48.128818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:48.129580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 45/89] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:48.135355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada4091-2cfc-48fd-9b7d-a851e202ad5b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:48.199776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5b86-cca0-4b57-a8b0-346bb1a25199 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.200037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5b86-cca0-4b57-a8b0-346bb1a25199 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.200258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5b86-cca0-4b57-a8b0-346bb1a25199 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.201798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 46/90] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:10:48.207237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81616-1183-4c21-9a24-1ff05bfcee06 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.207526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81616-1183-4c21-9a24-1ff05bfcee06 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.207791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea81616-1183-4c21-9a24-1ff05bfcee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.235011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9ea81616-1183-4c21-9a24-1ff05bfcee06 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:48.236644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9ea81616-1183-4c21-9a24-1ff05bfcee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:48.262393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:48.320240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:48.337894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada4091-2cfc-48fd-9b7d-a851e202ad5b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:48.355654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 47/91] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:10:48.358733 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7359389-b483-4917-aa0e-1135c1e8f946 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.359027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7359389-b483-4917-aa0e-1135c1e8f946 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.359322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7359389-b483-4917-aa0e-1135c1e8f946 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.360624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 48/92] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:48.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c692cf-0200-4f77-acf8-9e5c11d60ca5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.369260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c692cf-0200-4f77-acf8-9e5c11d60ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.369539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c692cf-0200-4f77-acf8-9e5c11d60ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.401223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:48.403522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.404017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.404503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.406035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:48.407342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:48.408915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-20c692cf-0200-4f77-acf8-9e5c11d60ca5 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:48.410158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:48.411629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-20c692cf-0200-4f77-acf8-9e5c11d60ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:48.433310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 45/93] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:10:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:48.444905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:48.542297 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 49/94] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:48.630321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d339c-ed06-4508-a020-24fbf64d773e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:48.668586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:48.677275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d517c4-9f51-4cfe-b6c9-53f150bacfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:48.677923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d517c4-9f51-4cfe-b6c9-53f150bacfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.678204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d517c4-9f51-4cfe-b6c9-53f150bacfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.678479 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d517c4-9f51-4cfe-b6c9-53f150bacfe8 None admin] PATH_INFO: `/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.679664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d517c4-9f51-4cfe-b6c9-53f150bacfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4d5aeb2b594f3aa580d835f5be6f43)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:48.679874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198db09b-8f57-40bd-b5fc-fd877ca1251e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.680346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198db09b-8f57-40bd-b5fc-fd877ca1251e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.680810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198db09b-8f57-40bd-b5fc-fd877ca1251e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.681125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d517c4-9f51-4cfe-b6c9-53f150bacfe8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:48.682565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 50/95] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:10:48.682679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 46/96] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:48 2022] GET /identity/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:48.689439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198db09b-8f57-40bd-b5fc-fd877ca1251e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:48.690367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0bb5-ca3d-4384-9d9c-c6ad73e39261 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.692089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0bb5-ca3d-4384-9d9c-c6ad73e39261 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.693768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0bb5-ca3d-4384-9d9c-c6ad73e39261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.726113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-90fe0bb5-ca3d-4384-9d9c-c6ad73e39261 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:48.728789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-90fe0bb5-ca3d-4384-9d9c-c6ad73e39261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:48.864263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 47/97] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:48.865254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0bb5-ca3d-4384-9d9c-c6ad73e39261 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:48.884366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198db09b-8f57-40bd-b5fc-fd877ca1251e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:48.902725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:48.946766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae420d3b-b0fa-4a7b-b621-ee1310a65590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:48.947717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae420d3b-b0fa-4a7b-b621-ee1310a65590 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:48.948140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae420d3b-b0fa-4a7b-b621-ee1310a65590 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:48.948554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae420d3b-b0fa-4a7b-b621-ee1310a65590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:48.978447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0bb5-ca3d-4384-9d9c-c6ad73e39261 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.008812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.018120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3d825-8075-4cdc-97a2-b2da0e842560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.018957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d825-8075-4cdc-97a2-b2da0e842560 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.019277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d825-8075-4cdc-97a2-b2da0e842560 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.019560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d825-8075-4cdc-97a2-b2da0e842560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.020683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3d825-8075-4cdc-97a2-b2da0e842560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:49.022146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3d825-8075-4cdc-97a2-b2da0e842560 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:49.023946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 48/98] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:49.024878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac580da-e6ec-4d1a-a505-d8c8033de08d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.025170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac580da-e6ec-4d1a-a505-d8c8033de08d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.025446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac580da-e6ec-4d1a-a505-d8c8033de08d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.026696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 49/99] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:49.027441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac580da-e6ec-4d1a-a505-d8c8033de08d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.030540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae420d3b-b0fa-4a7b-b621-ee1310a65590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:49.033071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae420d3b-b0fa-4a7b-b621-ee1310a65590 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:49.133647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac580da-e6ec-4d1a-a505-d8c8033de08d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.143982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 51/100] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:10:49.143982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81edc3-4f7b-49dc-938c-e306a89780fd None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.143982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81edc3-4f7b-49dc-938c-e306a89780fd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.143982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81edc3-4f7b-49dc-938c-e306a89780fd None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.143982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 52/101] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:49.143982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81edc3-4f7b-49dc-938c-e306a89780fd None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.157397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.177058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75c38d-14da-40a3-a6bc-099da7991421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.177692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75c38d-14da-40a3-a6bc-099da7991421 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.177973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75c38d-14da-40a3-a6bc-099da7991421 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.178243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75c38d-14da-40a3-a6bc-099da7991421 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.192904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75c38d-14da-40a3-a6bc-099da7991421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-cd75c38d-14da-40a3-a6bc-099da7991421 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:49.197860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:49.198905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:49.199833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 50/102] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:49.200456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf10b-05f9-4831-9cc1-58124a3f0f48 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.200456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf10b-05f9-4831-9cc1-58124a3f0f48 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.200728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf10b-05f9-4831-9cc1-58124a3f0f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.218860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9c7cf10b-05f9-4831-9cc1-58124a3f0f48 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:49.220092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9c7cf10b-05f9-4831-9cc1-58124a3f0f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:49.258374 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81edc3-4f7b-49dc-938c-e306a89780fd None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.268386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.285531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 51/103] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:49.286755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228472-920b-4661-93c4-a34fa84d7c09 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.287043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228472-920b-4661-93c4-a34fa84d7c09 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.287345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228472-920b-4661-93c4-a34fa84d7c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.293245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.293858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.294144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.294421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.295085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:49.296557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:49.304504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7f228472-920b-4661-93c4-a34fa84d7c09 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:49.305680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7f228472-920b-4661-93c4-a34fa84d7c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:49.335193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 53/104] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:10:49 2022] POST /identity/v3/projects => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:49.335193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.387520 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 52/105] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:49.392536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f228472-920b-4661-93c4-a34fa84d7c09 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.420651 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.468774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23add1ea-fd10-4587-a5bb-1067dca97ffb None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.511242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.512713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.512713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.512713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.514012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:49.515586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:49.517860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 54/106] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:49.518645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.583616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f228472-920b-4661-93c4-a34fa84d7c09 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.598857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.623577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.624516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.624516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.624757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.637990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:49.639914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740f0f5-c43c-4097-b795-d0e45925c101 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:49.643410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:49.644246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:49.644992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 53/107] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:49.645630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.676740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.682981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.683931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.684687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.685196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.686263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:49.686879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:49.688754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:49.698396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 55/108] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:49.703101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.773397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15618-aaee-4cb7-9fe3-1d074f18cc0f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.808670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.809021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ac4fe-4197-4e0c-8bf9-8a26f1a3f920 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.809282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.809620 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.809904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.810633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] RBAC: Adding query filter params (role.id=b0eca5323ad04e739e90f2372d36e579, scope.project.id=8571e31058db4740b3a460a83172d371, user.id=2a4d5aeb2b594f3aa580d835f5be6f43) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:49.810946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:49.812758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:49.823123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 54/109] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/role_assignments?user.id=2a4d5aeb2b594f3aa580d835f5be6f43&scope.project.id=8571e31058db4740b3a460a83172d371&role.id=b0eca5323ad04e739e90f2372d36e579 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:49.823123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.867906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.873804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.874468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.874756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.875362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.888317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:49.894300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:49.895208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:49.895960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 56/110] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:49.897134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:49.955251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873bb8-aaf8-4140-91cd-04104646aa8f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:49.958492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:49.993665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:49.994301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:49.994591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:49.994872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:49.995599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:49.995906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:49.997322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.008382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 55/111] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.009029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.018512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c159d-2c52-4f67-beb4-d2626fba343d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.056195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.056843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.057130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.057414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] PATH_INFO: `/v3/users/b210daad9a9b495d8953120273356466` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.077303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] RBAC: Authorizing `identity:get_user(user_id=b210daad9a9b495d8953120273356466)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.081284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.086116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 57/112] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:49 2022] GET /identity/v3/users/b210daad9a9b495d8953120273356466 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.086116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.127840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:50.130903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23df36-98b3-4da2-9dd0-173c061e0a99 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.174705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.175295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.175577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.175852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.190356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:50.195456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:50.196588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 56/113] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:50.197381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.210748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bf53-9e7b-4452-87d2-760659785b14 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.222507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:50.248887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.249821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.250795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.251096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.251778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:50.252088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.253492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.266809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 58/114] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.266809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.320291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a9ee5-ec0f-49fb-8ab8-577402c3a447 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.356428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.357064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.357347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.357628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] PATH_INFO: `/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.358768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] RBAC: Authorizing `identity:get_user(user_id=2a4d5aeb2b594f3aa580d835f5be6f43)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.360818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.367208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 57/115] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.367208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.372638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c274e-348b-4a10-b414-fe83994b7bf5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.397161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:50.411983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.412626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.412913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.413551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.414997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.416488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.423108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 59/116] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.423108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.469758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:50.480526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3ad0-ba59-4508-be49-ef288080bb6d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.516887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.517693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.518146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.518705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.519413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:50.519723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.521272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.534232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 58/117] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.534232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.534462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921c93-eb5d-4158-9703-92cce8fe06d4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.570219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.570959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.571342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.571702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] PATH_INFO: `/v3/users/84e8dce821b046efa98901e318ae5922` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.572953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] RBAC: Authorizing `identity:get_user(user_id=84e8dce821b046efa98901e318ae5922)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.574410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.576035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 60/118] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/users/84e8dce821b046efa98901e318ae5922 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.576787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.634556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:50.645943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd112-6dd4-4ba9-aed5-8e681999e2c8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.681083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.682006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.682392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.682668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.684471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20992b-9921-4c90-9a40-7d5972aad45e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.695394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:50.722068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.722657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.722940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.723259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371/users/b210daad9a9b495d8953120273356466/roles/b3a19dcb7d864ba8beaed2d22a226138` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.725190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8571e31058db4740b3a460a83172d371, user_id=b210daad9a9b495d8953120273356466, role_id=b3a19dcb7d864ba8beaed2d22a226138)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.726641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.740187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 61/119] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:50 2022] PUT /identity/v3/projects/8571e31058db4740b3a460a83172d371/users/b210daad9a9b495d8953120273356466/roles/b3a19dcb7d864ba8beaed2d22a226138 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:10:50.740996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.772213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.774845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.873514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909238a-0863-4501-a8d4-c449244b8fc1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:50.897232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:50.913282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 59/120] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:10:50.916031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.920654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:50.921298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:50.921637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:50.921956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] PATH_INFO: `/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:50.923885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] RBAC: Authorizing `identity:get_user(user_id=2a4d5aeb2b594f3aa580d835f5be6f43)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:50.925430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:50.927051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 62/121] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/users/2a4d5aeb2b594f3aa580d835f5be6f43 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:50.928475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:50.971265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:51.026700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4286a4-095a-45b8-ac1e-3ca191a7acc4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:51.049253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374138e6-d0a0-457e-a353-cffceac08cfb None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:51.064370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:51.064995 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.065279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.065559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.091687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:51.093505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.094535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.095037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] PATH_INFO: `/v3/projects/1513bf7ba820425fbfc366d85afe8f34` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.096585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] RBAC: Authorizing `identity:get_project(project_id=1513bf7ba820425fbfc366d85afe8f34)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:51.098845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:51.101050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 63/122] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/projects/1513bf7ba820425fbfc366d85afe8f34 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:51.106678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:51.133639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:51.145793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:51.147276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:51.227749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76e79-72fe-4f50-8690-24ae11fbed02 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:51.231642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:51.268133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 60/123] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:10:51.268828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:51.270154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815daafd-3966-4df7-a555-8681407cddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:51.271251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815daafd-3966-4df7-a555-8681407cddac None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.271738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815daafd-3966-4df7-a555-8681407cddac None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.273023 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815daafd-3966-4df7-a555-8681407cddac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.362538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815daafd-3966-4df7-a555-8681407cddac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:51.365022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815daafd-3966-4df7-a555-8681407cddac None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:51.377310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:51.388132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d2064-386c-4aef-b5b7-aaf6c745eaee None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:51.439068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:51.439754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.440092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.440435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.441494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] RBAC: Adding query filter params (role.id=b0eca5323ad04e739e90f2372d36e579, scope.project.id=1513bf7ba820425fbfc366d85afe8f34, user.id=2a4d5aeb2b594f3aa580d835f5be6f43) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:51.441870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:51.444317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:51.457115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 61/124] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:10:51 2022] GET /identity/v3/role_assignments?user.id=2a4d5aeb2b594f3aa580d835f5be6f43&scope.project.id=1513bf7ba820425fbfc366d85afe8f34&role.id=b0eca5323ad04e739e90f2372d36e579 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:51.457115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:51.524556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 64/125] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:10:51.530700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815daafd-3966-4df7-a555-8681407cddac None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:51.534584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:51.662110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815daafd-3966-4df7-a555-8681407cddac None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:51.685295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7aa66-6218-4300-836e-52a317336f38 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:51.705702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c720-7aa9-4793-8004-04d13e0cb912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:51.706365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c720-7aa9-4793-8004-04d13e0cb912 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.706646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c720-7aa9-4793-8004-04d13e0cb912 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.706921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c720-7aa9-4793-8004-04d13e0cb912 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.708105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c720-7aa9-4793-8004-04d13e0cb912 None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:51.709574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c720-7aa9-4793-8004-04d13e0cb912 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:51.711274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 65/126] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:51 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:51.712558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282092-fdfd-4cc5-8614-50b242ffab25 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.712732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282092-fdfd-4cc5-8614-50b242ffab25 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.713074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282092-fdfd-4cc5-8614-50b242ffab25 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.714628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 66/127] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:51.720362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282092-fdfd-4cc5-8614-50b242ffab25 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:51.743688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f5338-c6ea-4c28-940c-12edfbfa773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:51.744332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5338-c6ea-4c28-940c-12edfbfa773a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.744620 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5338-c6ea-4c28-940c-12edfbfa773a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.744898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5338-c6ea-4c28-940c-12edfbfa773a None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.747145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f5338-c6ea-4c28-940c-12edfbfa773a None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:51.748346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f5338-c6ea-4c28-940c-12edfbfa773a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:51.750145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 62/128] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:51 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:51.756830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d4c3-0405-443a-bb96-d89881465989 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.756830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d4c3-0405-443a-bb96-d89881465989 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.756830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94d4c3-0405-443a-bb96-d89881465989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.780197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bb94d4c3-0405-443a-bb96-d89881465989 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:51.781503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bb94d4c3-0405-443a-bb96-d89881465989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:51.802341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:51.825754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:51.861179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282092-fdfd-4cc5-8614-50b242ffab25 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:51.865749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 63/129] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:51.871510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d4c3-0405-443a-bb96-d89881465989 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:51.900214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:51.900843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:51.901128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:51.901398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:51.902131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] RBAC: Adding query filter params (role.id=c2a5de5e2b0745e89cd777db9a2d1099, scope.project.id=8571e31058db4740b3a460a83172d371, user.id=2a4d5aeb2b594f3aa580d835f5be6f43) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:51.902440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:51.904058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:51.919638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 67/130] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:10:51 2022] GET /identity/v3/role_assignments?user.id=2a4d5aeb2b594f3aa580d835f5be6f43&scope.project.id=8571e31058db4740b3a460a83172d371&role.id=c2a5de5e2b0745e89cd777db9a2d1099 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:51.987188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94d4c3-0405-443a-bb96-d89881465989 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:52.027027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:52.028032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:52.028539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:52.029014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:52.029966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=8571e31058db4740b3a460a83172d371, user.id=84e8dce821b046efa98901e318ae5922) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:52.030507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:52.032273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:52.039464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 64/131] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:10:51 2022] GET /identity/v3/role_assignments?user.id=84e8dce821b046efa98901e318ae5922&scope.project.id=8571e31058db4740b3a460a83172d371&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:52.146199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:52.260697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2dabc-8fd6-4439-b4e2-3ac0226ee0d5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:52.296197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c025d-6a45-4145-a30a-63d41fbb0c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:52.296830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c025d-6a45-4145-a30a-63d41fbb0c0c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:52.297168 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c025d-6a45-4145-a30a-63d41fbb0c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:52.297949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c025d-6a45-4145-a30a-63d41fbb0c0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:52.299066 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c025d-6a45-4145-a30a-63d41fbb0c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:52.300586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c025d-6a45-4145-a30a-63d41fbb0c0c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:52.302156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 68/132] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:52.307802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:52.326427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:52.405886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f442f5-1fe4-405b-8e73-4d56fc501fd6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:52.439340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bcd1-3558-415d-bd1b-35f172252563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:52.439918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bcd1-3558-415d-bd1b-35f172252563 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:52.440139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bcd1-3558-415d-bd1b-35f172252563 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:52.440411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bcd1-3558-415d-bd1b-35f172252563 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:52.441076 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bcd1-3558-415d-bd1b-35f172252563 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:52.442530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bcd1-3558-415d-bd1b-35f172252563 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:52.462729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 65/133] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:10:52 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:52.947109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737482a-e42e-4a9e-a117-4bd9033fbcbc None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:52.947646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737482a-e42e-4a9e-a117-4bd9033fbcbc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:52.947646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737482a-e42e-4a9e-a117-4bd9033fbcbc None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:52.949126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 69/134] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:52.955062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712339-50f0-4dc3-b90b-52d1164138ff None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:52.955604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712339-50f0-4dc3-b90b-52d1164138ff None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:52.956077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712339-50f0-4dc3-b90b-52d1164138ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:52.975695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2f712339-50f0-4dc3-b90b-52d1164138ff None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:52.977199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2f712339-50f0-4dc3-b90b-52d1164138ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:53.046595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 66/135] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:53.325217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737482a-e42e-4a9e-a117-4bd9033fbcbc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:53.331177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:53.433781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737482a-e42e-4a9e-a117-4bd9033fbcbc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:53.475775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:53.476764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:53.477275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:53.477744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:53.489930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:53.495054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:53.495905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:10:53.496678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:53.498867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 70/136] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:53.511136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f712339-50f0-4dc3-b90b-52d1164138ff None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:53.515418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:53.614946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f712339-50f0-4dc3-b90b-52d1164138ff None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:53.651287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:53.651918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:53.652204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:53.652483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:53.653170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:53.653478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:53.654875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:53.664247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 67/137] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:10:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:53.670101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:53.740070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:53.779107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f17d1-b4a7-4da8-8b7d-2cd9bbd6b3c4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:53.816016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:53.816715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:53.817003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:53.817448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] PATH_INFO: `/v3/users/b210daad9a9b495d8953120273356466` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:53.818673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] RBAC: Authorizing `identity:get_user(user_id=b210daad9a9b495d8953120273356466)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:53.820273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:53.822072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 71/138] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:53 2022] GET /identity/v3/users/b210daad9a9b495d8953120273356466 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:53.827710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:53.893318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:53.935108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec2057-f74d-40de-ac9f-f281224c0cc7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:53.969549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:53.970041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:53.970329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:53.970606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:54.039539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:54.041098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:54.102380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:54.145734 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 68/139] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:10:54.151388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:54.253716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24eb05-8fff-4897-a5c0-bb33bdf0e2bf None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:54.283687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:54.289312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3d303-651a-4643-b4ec-f29218038843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:54.290157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d303-651a-4643-b4ec-f29218038843 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:54.290619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d303-651a-4643-b4ec-f29218038843 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:54.291114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d303-651a-4643-b4ec-f29218038843 None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:54.292251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3d303-651a-4643-b4ec-f29218038843 None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:54.293713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3d303-651a-4643-b4ec-f29218038843 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:54.295370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 72/140] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:54 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:54.301512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:54.405441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182684c6-3d15-4b1b-b9a0-948edb138f10 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:54.442038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a64eb-d960-46c9-ada9-e768473b30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:54.442657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a64eb-d960-46c9-ada9-e768473b30c6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:54.442938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a64eb-d960-46c9-ada9-e768473b30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:54.443241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a64eb-d960-46c9-ada9-e768473b30c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:54.443980 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a64eb-d960-46c9-ada9-e768473b30c6 None admin] RBAC: Adding query filter params (role.id=b3a19dcb7d864ba8beaed2d22a226138, scope.project.id=8571e31058db4740b3a460a83172d371, user.id=b210daad9a9b495d8953120273356466) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:54.444289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a64eb-d960-46c9-ada9-e768473b30c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:54.445737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a64eb-d960-46c9-ada9-e768473b30c6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:54.452216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 69/141] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:10:54 2022] GET /identity/v3/role_assignments?user.id=b210daad9a9b495d8953120273356466&scope.project.id=8571e31058db4740b3a460a83172d371&role.id=b3a19dcb7d864ba8beaed2d22a226138 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:54.801205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896730e3-c265-4b30-93dc-3974bdbf428e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:54.801446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896730e3-c265-4b30-93dc-3974bdbf428e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:54.801712 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896730e3-c265-4b30-93dc-3974bdbf428e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:54.803107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 73/142] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:54.808332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2dff5-21db-4b72-a2df-32778653c62a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:54.808835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2dff5-21db-4b72-a2df-32778653c62a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:54.808933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2dff5-21db-4b72-a2df-32778653c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:54.830089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-84e2dff5-21db-4b72-a2df-32778653c62a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:54.831357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-84e2dff5-21db-4b72-a2df-32778653c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:54.857693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:54.915140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 70/143] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:54.931497 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572db7-161c-467e-90c8-9865a871796c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:54.931789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572db7-161c-467e-90c8-9865a871796c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:54.932069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572db7-161c-467e-90c8-9865a871796c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:54.933472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 74/144] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:54.938818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f11058-c018-43c2-8228-b4e6646b0aa8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:54.939132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f11058-c018-43c2-8228-b4e6646b0aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:54.939418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f11058-c018-43c2-8228-b4e6646b0aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:54.957911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-21f11058-c018-43c2-8228-b4e6646b0aa8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:54.959139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-21f11058-c018-43c2-8228-b4e6646b0aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:55.001691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5edc-bdf3-413c-b8bc-0a1b14e28a9f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.001984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5edc-bdf3-413c-b8bc-0a1b14e28a9f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.002269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5edc-bdf3-413c-b8bc-0a1b14e28a9f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.003673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 75/145] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:55.008716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8ef72-2efc-4362-9efd-9d7bb72efa7c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.009007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8ef72-2efc-4362-9efd-9d7bb72efa7c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.009295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8ef72-2efc-4362-9efd-9d7bb72efa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.028255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-31b8ef72-2efc-4362-9efd-9d7bb72efa7c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:55.028786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 71/146] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:55.029795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-31b8ef72-2efc-4362-9efd-9d7bb72efa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:55.098895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 76/147] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:10:55.181990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f11058-c018-43c2-8228-b4e6646b0aa8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.271847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:55.285178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f11058-c018-43c2-8228-b4e6646b0aa8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.296409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8ef72-2efc-4362-9efd-9d7bb72efa7c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.321777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.322410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.322691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.322979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.333551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:55.338379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:55.339250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:55.340039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 72/148] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:55.346590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.401886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8ef72-2efc-4362-9efd-9d7bb72efa7c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.430178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:55.436869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.437764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.438572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.438845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.446385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9687c-7519-4b1b-8eef-7cf54f48a44c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.448731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:55.453548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:55.455002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:55.455844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 77/149] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:10:55.457187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.480850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.481459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.481746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.482024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.482694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:55.483006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:55.484441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:55.492343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 73/150] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:55.495955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.509515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:55.555041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3038-984b-4fd3-bdc8-7b89f51eba73 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.589476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.590416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.590693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.590964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.592099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:55.593587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:55.598230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 78/151] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:55.598230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.601817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764e171-c14c-4e93-b81e-8089d8194de0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.635557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.636165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.636450 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.636740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.637404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:55.637713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:55.639154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:55.646871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 74/152] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:55.647672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.653124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:55.694376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef473-445a-444c-b283-0617d9d3a261 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.715313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:55.727288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.727910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.728187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.728454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] PATH_INFO: `/v3/users/0783931b217d4587b6de44e2ded766e2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.741610 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] RBAC: Authorizing `identity:get_user(user_id=0783931b217d4587b6de44e2ded766e2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:55.743047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:55.744820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 79/153] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/users/0783931b217d4587b6de44e2ded766e2 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:55.745408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.746035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b29f-cbf5-494d-9485-9d7960a88957 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.779517 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.780116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.780400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.780673 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.781323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:55.782803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:55.804042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 75/154] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:10:55 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:55.804858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.856146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0716b94-bac0-4de8-9d1c-55971cb8d87d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.876627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:55.898061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.898727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.899012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.899547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] PATH_INFO: `/v3/users/0783931b217d4587b6de44e2ded766e2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.901267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] RBAC: Authorizing `identity:get_user(user_id=0783931b217d4587b6de44e2ded766e2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:55.903041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:55.905071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 80/155] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/users/0783931b217d4587b6de44e2ded766e2 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:55.910745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:55.920812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f98d3c-c6b4-4f51-9ef0-79b275ef1f19 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:55.951505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:55.961000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:55.962051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:55.962693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:55.963275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:55.965397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:55.966952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:55.968860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 76/156] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:55.975044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:56.025826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e09a3-3822-44d9-a958-7d5df69cf0a4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:56.065609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:56.068049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:56.068049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:56.068049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:56.068966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:56.070816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:56.072483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 81/157] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:55 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:10:56.077931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:56.096993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d077e-ab61-4fd4-8dbb-52951b275312 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:56.141841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567f59-a7d2-401a-83b4-23ac4b6cf929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:56.142519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567f59-a7d2-401a-83b4-23ac4b6cf929 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:56.142804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567f59-a7d2-401a-83b4-23ac4b6cf929 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:56.143103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567f59-a7d2-401a-83b4-23ac4b6cf929 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/0783931b217d4587b6de44e2ded766e2/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:56.145054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf567f59-a7d2-401a-83b4-23ac4b6cf929 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cdf1e43e04850ab133c8752006c72, user_id=0783931b217d4587b6de44e2ded766e2, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:56.146519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf567f59-a7d2-401a-83b4-23ac4b6cf929 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:56.148274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:56.165896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 77/158] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:55 2022] PUT /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/0783931b217d4587b6de44e2ded766e2/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:10:56.221878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bdb92-c249-44b8-b1c8-4e2568b862d0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:56.263882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84044-1427-49f7-806f-0e5aec7603e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:56.264947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84044-1427-49f7-806f-0e5aec7603e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:56.265505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84044-1427-49f7-806f-0e5aec7603e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:56.266018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84044-1427-49f7-806f-0e5aec7603e0 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/0783931b217d4587b6de44e2ded766e2/roles/c2a5de5e2b0745e89cd777db9a2d1099` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:56.268642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84044-1427-49f7-806f-0e5aec7603e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cdf1e43e04850ab133c8752006c72, user_id=0783931b217d4587b6de44e2ded766e2, role_id=c2a5de5e2b0745e89cd777db9a2d1099)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:56.270461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84044-1427-49f7-806f-0e5aec7603e0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:56.289450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 82/159] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:56 2022] PUT /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/0783931b217d4587b6de44e2ded766e2/roles/c2a5de5e2b0745e89cd777db9a2d1099 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:10:58.067311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ecff8-b498-45d6-9255-09d563fa284a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.067932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ecff8-b498-45d6-9255-09d563fa284a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.067932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ecff8-b498-45d6-9255-09d563fa284a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.069347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 78/160] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:58.074582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769166-ac14-4827-b5f5-9aef95a665c0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.075010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769166-ac14-4827-b5f5-9aef95a665c0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.075208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769166-ac14-4827-b5f5-9aef95a665c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.093649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c1769166-ac14-4827-b5f5-9aef95a665c0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:58.094908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c1769166-ac14-4827-b5f5-9aef95a665c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:58.173435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 83/161] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:58.237391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4928-c597-4252-860b-b18f23571a37 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.238066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4928-c597-4252-860b-b18f23571a37 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.238554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4928-c597-4252-860b-b18f23571a37 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.240164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 79/162] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:58.245730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c2436-f7e8-4549-bde5-7affb76873cb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.246257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c2436-f7e8-4549-bde5-7affb76873cb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.246752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c2436-f7e8-4549-bde5-7affb76873cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.266536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d74c2436-f7e8-4549-bde5-7affb76873cb None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:58.268201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d74c2436-f7e8-4549-bde5-7affb76873cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:58.308432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:58.344785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 84/163] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:58.380280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc1b7d-091e-4293-8574-3622e2d656fc None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.380563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc1b7d-091e-4293-8574-3622e2d656fc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.380837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc1b7d-091e-4293-8574-3622e2d656fc None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.382323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 80/164] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:10:58.387538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535935-dc72-4eb5-93c2-b2ddba31aaa7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.388020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535935-dc72-4eb5-93c2-b2ddba31aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.388475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535935-dc72-4eb5-93c2-b2ddba31aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.406602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-65535935-dc72-4eb5-93c2-b2ddba31aaa7 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:58.408608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-65535935-dc72-4eb5-93c2-b2ddba31aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:58.444758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2520-b5b8-44dc-b6b4-43f63c13d753 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.445043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2520-b5b8-44dc-b6b4-43f63c13d753 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.445321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2520-b5b8-44dc-b6b4-43f63c13d753 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.446794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 81/165] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:10:58.451939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8605a-5867-4250-ae29-25a79489972a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.452224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8605a-5867-4250-ae29-25a79489972a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.452499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8605a-5867-4250-ae29-25a79489972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.472365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-84f8605a-5867-4250-ae29-25a79489972a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:10:58.473564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-84f8605a-5867-4250-ae29-25a79489972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:10:58.483794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 85/166] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:10:58.492580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65535935-dc72-4eb5-93c2-b2ddba31aaa7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:58.526541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:58.547291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 82/167] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:10:58.612010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65535935-dc72-4eb5-93c2-b2ddba31aaa7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:58.613725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:58.635096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8605a-5867-4250-ae29-25a79489972a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:58.649752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:58.650397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.650675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.651228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.665245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:58.671990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:58.673218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:10:58.674121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 86/168] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:58.680729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:58.744971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8605a-5867-4250-ae29-25a79489972a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:58.782762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:58.783746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.784035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.784301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.785432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:58.786885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:58.788653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 83/169] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:58.789345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:58.796312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9199-be26-4abb-9885-630edecdcdf3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:58.838764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:58.839408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.839693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.839970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.840641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:58.840947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:58.842346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:58.850452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:58.850983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 87/170] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:58.851887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:58.875970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:58.902714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1255-0f58-4551-997b-6f0ffa2612a5 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:58.936841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:58.937720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.938523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.938798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.948914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:58.952842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4b523-0a42-447c-b698-edc106f5be63 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:58.954698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:58.955585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:58.956398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 84/171] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:58.957055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:58.986466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:58.987072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:58.987383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:58.987658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:58.988313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:58.989758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.017497 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 88/172] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:10:58 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:10:59.018336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.065488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6175a3-ec82-4ee1-9584-17caf34e2402 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.082473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.106969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.107670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.107955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.108233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.119855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:10:59.123046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:10:59.125315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:10:59.126775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 85/173] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:10:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:10:59.127964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.152648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8365ead-691a-4341-9a76-cadc42988fc1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.200961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.201613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.202006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.202200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] PATH_INFO: `/v3/users/08d1826f0ea5475f9f783034f541e4e6` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.218596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] RBAC: Authorizing `identity:get_user(user_id=08d1826f0ea5475f9f783034f541e4e6)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.220155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.221840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 89/174] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/users/08d1826f0ea5475f9f783034f541e4e6 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:59.223816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.254092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a67172-b769-4abb-9fb9-596cb664bce9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.299419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.300274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.300708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.301162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.301843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:59.302152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.303601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.315452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 86/175] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:59.316306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.348203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972ce7-6680-43d6-90d1-271dd92a14f9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.361194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.389448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.390033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.390316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.390589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.392507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:10:59.392507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.394858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.400943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.404634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 90/176] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:59.404634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.447486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e288db0-aa15-474c-9a28-e537e265ad48 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.488379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.488924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.489196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.489473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.490599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.492213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.493854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 87/177] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:59.494735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.551663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86013207-6a1e-42fb-81b2-eb360b24d742 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.601856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.602828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.603317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.603788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] PATH_INFO: `/v3/users/0783931b217d4587b6de44e2ded766e2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.603904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966897-47c8-4baf-92c8-a6c9fd34d228 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.605512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] RBAC: Authorizing `identity:get_user(user_id=0783931b217d4587b6de44e2ded766e2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.607244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.609414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.611650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 91/178] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/users/0783931b217d4587b6de44e2ded766e2 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:59.612273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.647287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.648357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.648879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.649360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] PATH_INFO: `/v3/users/0783931b217d4587b6de44e2ded766e2` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.650807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] RBAC: Authorizing `identity:get_user(user_id=0783931b217d4587b6de44e2ded766e2)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.652812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.654735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 88/179] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/users/0783931b217d4587b6de44e2ded766e2 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:10:59.655952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.697811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.742259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acbd9d-b72f-4340-a3a4-2f1baa49fac1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.771565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04123cf6-47bc-4ae6-9574-114d0272d720 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.790972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.791758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.792042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.792321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/08d1826f0ea5475f9f783034f541e4e6/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.794807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cdf1e43e04850ab133c8752006c72, user_id=08d1826f0ea5475f9f783034f541e4e6, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.796583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.811212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.812257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.812930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 92/180] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:10:59 2022] PUT /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/08d1826f0ea5475f9f783034f541e4e6/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:10:59.813806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.814324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:10:59.814597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:10:59.864725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.895239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:10:59.896787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:10:59.939884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa175d46-f43e-4058-b272-4afcdff6ef76 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:10:59.971994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:10:59.984164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:10:59.985232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:10:59.986111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:10:59.986866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:00.008271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 89/181] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:00.014187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:00.067250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:00.069296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:00.102454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:00.141637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4af7d-4e54-4e3f-bba7-c92de73c7acc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:00.204354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:00.206112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:00.207195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:00.207680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:00.211851 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:00.213563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:00.214048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 93/182] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:00.216301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 90/183] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:00 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:00.217371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:00.226159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:00.265688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:00.393163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c081-9213-49b8-b98d-f3846a5e546b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:00.412259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74180b56-3ec8-440e-8a56-4140203b3601 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:00.460841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:00.461833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:00.462317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:00.462787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:00.463793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=8d3cdf1e43e04850ab133c8752006c72, user.id=0783931b217d4587b6de44e2ded766e2) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:00.464297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:00.466135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:00.471783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c95a23-20f3-47b7-ade5-a1358f411e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:00.472432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95a23-20f3-47b7-ade5-a1358f411e53 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:00.472717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95a23-20f3-47b7-ade5-a1358f411e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:00.472996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95a23-20f3-47b7-ade5-a1358f411e53 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:00.473894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 91/184] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:00 2022] GET /identity/v3/role_assignments?user.id=0783931b217d4587b6de44e2ded766e2&scope.project.id=8d3cdf1e43e04850ab133c8752006c72&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:00.474249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c95a23-20f3-47b7-ade5-a1358f411e53 None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:00.483151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c95a23-20f3-47b7-ade5-a1358f411e53 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:00.483151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 94/185] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:00 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:00.483780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:00.488254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:00.617434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05eb7-116e-436c-953d-d85079932f39 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:00.655265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede17378-8d03-492a-8129-1b5bc7d44350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:00.655907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede17378-8d03-492a-8129-1b5bc7d44350 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:00.656189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede17378-8d03-492a-8129-1b5bc7d44350 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:00.656468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede17378-8d03-492a-8129-1b5bc7d44350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:00.657775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede17378-8d03-492a-8129-1b5bc7d44350 None admin] RBAC: Adding query filter params (role.id=c2a5de5e2b0745e89cd777db9a2d1099, scope.project.id=8d3cdf1e43e04850ab133c8752006c72, user.id=0783931b217d4587b6de44e2ded766e2) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:00.658091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede17378-8d03-492a-8129-1b5bc7d44350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:00.659634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede17378-8d03-492a-8129-1b5bc7d44350 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:00.670900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 92/186] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:00 2022] GET /identity/v3/role_assignments?user.id=0783931b217d4587b6de44e2ded766e2&scope.project.id=8d3cdf1e43e04850ab133c8752006c72&role.id=c2a5de5e2b0745e89cd777db9a2d1099 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:01.474184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ab5cf-2199-4881-b855-68e90f915cca None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:01.474707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ab5cf-2199-4881-b855-68e90f915cca None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:01.474707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ab5cf-2199-4881-b855-68e90f915cca None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:01.476283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 95/187] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:01.481768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122cd9-cfb1-457a-b7de-d146669047f8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:01.482229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122cd9-cfb1-457a-b7de-d146669047f8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:01.482325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122cd9-cfb1-457a-b7de-d146669047f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:01.500747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1c122cd9-cfb1-457a-b7de-d146669047f8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:01.501928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1c122cd9-cfb1-457a-b7de-d146669047f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:01.564361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:01.567590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701310-52ce-4959-87ba-976d26540618 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:01.567859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701310-52ce-4959-87ba-976d26540618 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:01.568135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701310-52ce-4959-87ba-976d26540618 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:01.569458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 96/188] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:01.571627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 93/189] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:01.574355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979747-9ae7-44f7-a38a-9b5d2bec7e22 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:01.574710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979747-9ae7-44f7-a38a-9b5d2bec7e22 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:01.575061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979747-9ae7-44f7-a38a-9b5d2bec7e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:01.593246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1f979747-9ae7-44f7-a38a-9b5d2bec7e22 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:01.595170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1f979747-9ae7-44f7-a38a-9b5d2bec7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:01.659527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 97/190] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:01.845501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c122cd9-cfb1-457a-b7de-d146669047f8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:01.931270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979747-9ae7-44f7-a38a-9b5d2bec7e22 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:01.944688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c122cd9-cfb1-457a-b7de-d146669047f8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:01.958517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:01.982732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:01.983411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:01.983688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:01.983962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:01.985193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:01.986707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:01.988526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 94/191] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:01.993625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:02.036171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979747-9ae7-44f7-a38a-9b5d2bec7e22 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:02.057572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:02.071377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:02.072025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.072319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.072578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.083870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:02.088783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:02.089679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:02.090469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:02.091808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 98/192] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:02.096979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:02.099485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dab414-36d3-4c51-92d0-ca6f59f885dc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:02.134011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:02.134613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.134886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.135298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.135954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:02.137402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:02.163223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 95/193] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:01 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:02.197960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:02.216076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c53d6-4932-463f-bb3a-34a71e7c00f3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:02.257825 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5bc5f-a589-4e30-b2a0-618ae26f92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:02.258453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bc5f-a589-4e30-b2a0-618ae26f92da None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.258738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bc5f-a589-4e30-b2a0-618ae26f92da None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.259010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bc5f-a589-4e30-b2a0-618ae26f92da None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.259731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5bc5f-a589-4e30-b2a0-618ae26f92da None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:02.260036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5bc5f-a589-4e30-b2a0-618ae26f92da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:02.261465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5bc5f-a589-4e30-b2a0-618ae26f92da None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:02.271745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 99/194] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:02.277249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:02.342145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469411-0fda-4a3a-8e88-35eb31e18982 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.342445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469411-0fda-4a3a-8e88-35eb31e18982 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.342703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469411-0fda-4a3a-8e88-35eb31e18982 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.345041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 100/195] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:02.350232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420106-a6c7-4d65-81f6-5badca27a4b6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.350457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420106-a6c7-4d65-81f6-5badca27a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.350739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420106-a6c7-4d65-81f6-5badca27a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.373722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0e420106-a6c7-4d65-81f6-5badca27a4b6 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:02.374949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0e420106-a6c7-4d65-81f6-5badca27a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:02.392675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab610a-bd21-446c-b2ba-1d48e986a281 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:02.417693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:02.433451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:02.434099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.434386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.434661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] PATH_INFO: `/v3/users/122ce13a3d3d4cf68bdc9ee7300a7fa9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.450748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] RBAC: Authorizing `identity:get_user(user_id=122ce13a3d3d4cf68bdc9ee7300a7fa9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:02.452308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:02.454279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 96/196] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:02 2022] GET /identity/v3/users/122ce13a3d3d4cf68bdc9ee7300a7fa9 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:02.456674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 101/197] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:02.459711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:02.572902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a5b1-8f13-4d73-bc8e-6ca44984393a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:02.609644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:02.611058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.611566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.611989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.613345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:02.614992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:02.617108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 97/198] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:02 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:02.624174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e420106-a6c7-4d65-81f6-5badca27a4b6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:02.706248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:02.733092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e420106-a6c7-4d65-81f6-5badca27a4b6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:02.736697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:02.768429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:02.769097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.769380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.769652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/122ce13a3d3d4cf68bdc9ee7300a7fa9/roles/b3a19dcb7d864ba8beaed2d22a226138` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.771623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cdf1e43e04850ab133c8752006c72, user_id=122ce13a3d3d4cf68bdc9ee7300a7fa9, role_id=b3a19dcb7d864ba8beaed2d22a226138)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:02.773090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:02.790791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 102/199] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:02 2022] PUT /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72/users/122ce13a3d3d4cf68bdc9ee7300a7fa9/roles/b3a19dcb7d864ba8beaed2d22a226138 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:02.800621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:02.865749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3d72-0005-47de-b6ee-27d6a7537aa2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:02.906381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:02.907966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:02.908444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:02.908894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:02.926892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:02.932496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:02.933454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:02.934252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 98/200] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:02.940143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:03.047021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa53b4d-88a5-4cfa-a90f-03e10543cc9e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:03.084161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:03.084781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:03.085059 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:03.085331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:03.086007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:03.086313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:03.087746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:03.093331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:03.098472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 103/201] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:03.104115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:03.213724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db1930-0987-4a93-b349-9b42831aa4a2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:03.225498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:03.254654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:03.255774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:03.256277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:03.256789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] PATH_INFO: `/v3/users/08d1826f0ea5475f9f783034f541e4e6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:03.258210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] RBAC: Authorizing `identity:get_user(user_id=08d1826f0ea5475f9f783034f541e4e6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:03.260019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:03.261844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 99/202] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:03 2022] GET /identity/v3/users/08d1826f0ea5475f9f783034f541e4e6 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:03.272218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:03.375422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47e7b8-d4ac-4097-b196-283097ca022e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:03.413384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:03.414307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:03.414782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:03.415300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:03.488082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:03.491180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:03.493027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:03.609127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 104/203] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:03.616199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:03.724251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a730b-4fc2-4234-8b1c-67a201f6e5b8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:03.760754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee0afb-3c85-4252-91ff-9c66863f6a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:03.761312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee0afb-3c85-4252-91ff-9c66863f6a9f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:03.761593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee0afb-3c85-4252-91ff-9c66863f6a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:03.761866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee0afb-3c85-4252-91ff-9c66863f6a9f None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:03.762991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee0afb-3c85-4252-91ff-9c66863f6a9f None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:03.764799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee0afb-3c85-4252-91ff-9c66863f6a9f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:03.766986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 100/204] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:03 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:03.776234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:03.887927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af0a4-2c6f-4151-9419-3d3e643b7d1f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:03.891515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:03.925912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57992f57-e2cd-424e-a96b-ed9b33f87695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:03.926517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992f57-e2cd-424e-a96b-ed9b33f87695 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:03.926795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992f57-e2cd-424e-a96b-ed9b33f87695 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:03.927068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992f57-e2cd-424e-a96b-ed9b33f87695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:03.927817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992f57-e2cd-424e-a96b-ed9b33f87695 None admin] RBAC: Adding query filter params (role.id=b0eca5323ad04e739e90f2372d36e579, scope.project.id=8d3cdf1e43e04850ab133c8752006c72, user.id=08d1826f0ea5475f9f783034f541e4e6) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:03.928122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992f57-e2cd-424e-a96b-ed9b33f87695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:03.929570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992f57-e2cd-424e-a96b-ed9b33f87695 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:03.935752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 105/205] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:03 2022] GET /identity/v3/role_assignments?user.id=08d1826f0ea5475f9f783034f541e4e6&scope.project.id=8d3cdf1e43e04850ab133c8752006c72&role.id=b0eca5323ad04e739e90f2372d36e579 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:04.552383 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153ed5-dc28-4ce2-a766-dbd88572c577 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:04.552729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153ed5-dc28-4ce2-a766-dbd88572c577 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:04.552903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153ed5-dc28-4ce2-a766-dbd88572c577 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:04.554384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 101/206] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:04.559342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9b040-d032-4577-847d-b747092c340d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:04.559626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9b040-d032-4577-847d-b747092c340d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:04.559896 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9b040-d032-4577-847d-b747092c340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:04.577903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a8e9b040-d032-4577-847d-b747092c340d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:04.579632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a8e9b040-d032-4577-847d-b747092c340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:04.599910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0fda8-07a7-4e33-88a8-a80581be6cf4 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:04.600243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0fda8-07a7-4e33-88a8-a80581be6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:04.600469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0fda8-07a7-4e33-88a8-a80581be6cf4 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:04.601950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 102/207] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:04.606557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1427ce2-3d30-4aa4-9ddb-b7f5ef24dfa3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:04.606841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1427ce2-3d30-4aa4-9ddb-b7f5ef24dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:04.607150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1427ce2-3d30-4aa4-9ddb-b7f5ef24dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:04.624960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d1427ce2-3d30-4aa4-9ddb-b7f5ef24dfa3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:04.626257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d1427ce2-3d30-4aa4-9ddb-b7f5ef24dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:04.650369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 106/208] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:04.666525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:04.694013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 103/209] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:04.917642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9b040-d032-4577-847d-b747092c340d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:04.960733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1427ce2-3d30-4aa4-9ddb-b7f5ef24dfa3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:05.015327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:05.027453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9b040-d032-4577-847d-b747092c340d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.066252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.066885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.067188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.067459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.073811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1427ce2-3d30-4aa4-9ddb-b7f5ef24dfa3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.077571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:05.082424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:05.083339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:05.084237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:05.087384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 107/210] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:05.089076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:05.112311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b8d30-217e-4876-8dec-a9b3ed03c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.112954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8d30-217e-4876-8dec-a9b3ed03c93f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.113237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8d30-217e-4876-8dec-a9b3ed03c93f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.113513 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b8d30-217e-4876-8dec-a9b3ed03c93f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.114611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b8d30-217e-4876-8dec-a9b3ed03c93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:05.116100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b8d30-217e-4876-8dec-a9b3ed03c93f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:05.117693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 104/211] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:05.121797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093937b-c845-4e7b-b666-0e2b6378f8fb None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.122084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093937b-c845-4e7b-b666-0e2b6378f8fb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.122358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093937b-c845-4e7b-b666-0e2b6378f8fb None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.123896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 105/212] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:05.124435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093937b-c845-4e7b-b666-0e2b6378f8fb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:05.168867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:05.197381 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39748-70c5-42da-8460-a8d1e907755a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.228833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093937b-c845-4e7b-b666-0e2b6378f8fb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.230931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd01b97-b4bd-4800-8304-f7bb724ba5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.231570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd01b97-b4bd-4800-8304-f7bb724ba5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.231854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd01b97-b4bd-4800-8304-f7bb724ba5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.232132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd01b97-b4bd-4800-8304-f7bb724ba5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.232802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd01b97-b4bd-4800-8304-f7bb724ba5c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:05.233107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd01b97-b4bd-4800-8304-f7bb724ba5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:05.234509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd01b97-b4bd-4800-8304-f7bb724ba5c6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:05.243012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 108/213] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:05.247730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c388f-7ee1-4457-8c54-77dbd288083c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.247730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c388f-7ee1-4457-8c54-77dbd288083c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.247730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c388f-7ee1-4457-8c54-77dbd288083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.262236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7a6c388f-7ee1-4457-8c54-77dbd288083c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:05.262745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.263377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.263470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7a6c388f-7ee1-4457-8c54-77dbd288083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:05.263661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.263936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.264596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:05.266050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:05.273840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:05.287068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 106/214] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:05 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:05.287911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:05.343455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 109/215] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:05.395514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:05.400503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebfdc9-a6ce-4a3f-b182-88d730fdddc6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.442998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.443589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.443870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.444144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] PATH_INFO: `/v3/users/3097aabd3eec4ef1aa088ab304f67bb0` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.459662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] RBAC: Authorizing `identity:get_user(user_id=3097aabd3eec4ef1aa088ab304f67bb0)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:05.461226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:05.462928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 107/216] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:05 2022] GET /identity/v3/users/3097aabd3eec4ef1aa088ab304f67bb0 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:05.468724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c388f-7ee1-4457-8c54-77dbd288083c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:05.577256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c388f-7ee1-4457-8c54-77dbd288083c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.614328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.614603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:05.615415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.615699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.615973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.616716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] RBAC: Adding query filter params (role.id=b0eca5323ad04e739e90f2372d36e579, user.id=3097aabd3eec4ef1aa088ab304f67bb0, scope.system=all) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:05.617027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:05.618616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:05.624422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 110/217] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Oct 19 13:11:05 2022] GET /identity/v3/role_assignments?user.id=3097aabd3eec4ef1aa088ab304f67bb0&scope.system=all&role.id=b0eca5323ad04e739e90f2372d36e579 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:05.738027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8783b5-7dce-40cf-a92c-47a83289bc2c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.779309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.780324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.780780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.781215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.794481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:05.799781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:05.801271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:05.802067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 108/218] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:05.808448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:05.825695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:05.927172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72034b8-0cc9-4211-b8ab-69cf60673636 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:05.965599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:05.966222 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:05.966506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:05.966783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:05.967502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:05.967810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:05.969288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:05.978459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 111/219] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:05.984176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:06.005300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:06.095446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea3cbb-acbd-402f-a6ca-9ee9fba7f918 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:06.137595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:06.138279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:06.138563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:06.138833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] PATH_INFO: `/v3/users/122ce13a3d3d4cf68bdc9ee7300a7fa9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:06.139990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] RBAC: Authorizing `identity:get_user(user_id=122ce13a3d3d4cf68bdc9ee7300a7fa9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:06.141458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:06.143032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 109/220] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:05 2022] GET /identity/v3/users/122ce13a3d3d4cf68bdc9ee7300a7fa9 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:06.152196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:06.228255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:06.265447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d124-4734-4365-91bb-a0f57155ee36 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:06.302150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:06.302768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:06.303056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:06.303358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:06.374138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:06.375638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:06.452762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:06.486770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 112/221] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:06.496458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:06.585834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:06.603342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fe8c3-5a35-4bc0-ac94-d166aaae5047 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:06.637607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1450fa-f4ba-42df-a074-0c7f61d8c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:06.638236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1450fa-f4ba-42df-a074-0c7f61d8c72f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:06.638514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1450fa-f4ba-42df-a074-0c7f61d8c72f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:06.638782 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1450fa-f4ba-42df-a074-0c7f61d8c72f None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:06.639933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1450fa-f4ba-42df-a074-0c7f61d8c72f None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:06.641492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1450fa-f4ba-42df-a074-0c7f61d8c72f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:06.643500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 110/222] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:06 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:06.649345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:06.752312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b41af-2f69-4b86-b893-c08159dae3ea None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:06.786820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e6a87-7def-452e-90ec-b0ebcd9459a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:06.787458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6a87-7def-452e-90ec-b0ebcd9459a9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:06.787737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6a87-7def-452e-90ec-b0ebcd9459a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:06.788012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e6a87-7def-452e-90ec-b0ebcd9459a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:06.788743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6a87-7def-452e-90ec-b0ebcd9459a9 None admin] RBAC: Adding query filter params (role.id=b3a19dcb7d864ba8beaed2d22a226138, scope.project.id=8d3cdf1e43e04850ab133c8752006c72, user.id=122ce13a3d3d4cf68bdc9ee7300a7fa9) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:06.789060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6a87-7def-452e-90ec-b0ebcd9459a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:06.790706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e6a87-7def-452e-90ec-b0ebcd9459a9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:06.796606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 113/223] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:06 2022] GET /identity/v3/role_assignments?user.id=122ce13a3d3d4cf68bdc9ee7300a7fa9&scope.project.id=8d3cdf1e43e04850ab133c8752006c72&role.id=b3a19dcb7d864ba8beaed2d22a226138 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:07.683909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b592c5-5f35-4a56-a68c-620304e0ad7f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:07.684428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b592c5-5f35-4a56-a68c-620304e0ad7f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:07.684428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b592c5-5f35-4a56-a68c-620304e0ad7f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:07.685938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 111/224] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:07.691737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493fdd-0aab-4b74-902e-5c464ada8b90 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:07.692122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493fdd-0aab-4b74-902e-5c464ada8b90 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:07.692278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493fdd-0aab-4b74-902e-5c464ada8b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:07.710131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-49493fdd-0aab-4b74-902e-5c464ada8b90 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:07.711329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-49493fdd-0aab-4b74-902e-5c464ada8b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:07.726977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0821100-1801-450f-84a1-b292d07df91c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:07.727377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0821100-1801-450f-84a1-b292d07df91c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:07.727727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0821100-1801-450f-84a1-b292d07df91c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:07.729366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 112/225] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:07.736314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeb229-430b-497c-9ed6-ff960562dafc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:07.736851 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeb229-430b-497c-9ed6-ff960562dafc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:07.737323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeb229-430b-497c-9ed6-ff960562dafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:07.743260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:07.759868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-41aeb229-430b-497c-9ed6-ff960562dafc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:07.761729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-41aeb229-430b-497c-9ed6-ff960562dafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:07.787934 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 114/226] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:07.840333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 113/227] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:07.883105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e969a-5c39-493c-8332-2d99efa329d8 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:07.883404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e969a-5c39-493c-8332-2d99efa329d8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:07.883687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e969a-5c39-493c-8332-2d99efa329d8 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:07.885246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 115/228] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:07.890107 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeedab-9f51-4caa-a158-91dff46aa51f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:07.890400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeedab-9f51-4caa-a158-91dff46aa51f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:07.890681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeedab-9f51-4caa-a158-91dff46aa51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:07.909832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1bdeedab-9f51-4caa-a158-91dff46aa51f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:07.911017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1bdeedab-9f51-4caa-a158-91dff46aa51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:07.977867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 114/229] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:08.054629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e969a-5c39-493c-8332-2d99efa329d8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.123166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdeedab-9f51-4caa-a158-91dff46aa51f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.138352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:08.156096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e969a-5c39-493c-8332-2d99efa329d8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.198488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.199254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.199537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.199814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.212800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:08.217589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:08.218455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:08.219282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 116/230] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:08.225699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.235334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdeedab-9f51-4caa-a158-91dff46aa51f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.253873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:08.271086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.271737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.272018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.272288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.273382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:08.274837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:08.276427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 115/231] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:08.277182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.329691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75f255-b75f-4da4-8012-606d4c4670a5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.356858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:08.362147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.362753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.363026 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.363322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.363987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:08.364302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:08.365672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:08.373495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 117/232] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:08.376503 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.378724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48872978-9d51-4a66-b146-fba70edfe66e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.410837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.411497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.411780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.412059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.421926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:08.427743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:08.428661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:08.429455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 116/233] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:08.430122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.461151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:08.473123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061499-0229-40de-8cf6-e39bda751c85 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.507208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.507754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.508029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.508308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] PATH_INFO: `/v3/groups` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.508932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:08.510359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:08.525326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 118/234] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Oct 19 13:11:08 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:08.525931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.532043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30523d2e-a962-4050-9691-cc0a0c461a92 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.570422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.571071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.571380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.571652 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] PATH_INFO: `/v3/users/7d42f85ea6d44269b13b38887ceed45e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.583975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:08.587697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] RBAC: Authorizing `identity:get_user(user_id=7d42f85ea6d44269b13b38887ceed45e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:08.590122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:08.592597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 117/235] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/users/7d42f85ea6d44269b13b38887ceed45e => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:08.598356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.642722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f1608-2277-459e-a5f4-2c2d2adad2ff None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.685670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.686303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.686580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.686851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.687719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:08.688939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:08.690326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:08.700482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 119/236] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:08.706980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.709863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc95d-74ca-4dc2-8d87-ed15b77811e4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.722375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:08.749265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.749931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.750220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.750504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.751801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] RBAC: Adding query filter params (role.id=b3a19dcb7d864ba8beaed2d22a226138, user.id=7d42f85ea6d44269b13b38887ceed45e, scope.system=all) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:08.752203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:08.753698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:08.760843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 118/237] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/role_assignments?user.id=7d42f85ea6d44269b13b38887ceed45e&scope.system=all&role.id=b3a19dcb7d864ba8beaed2d22a226138 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:08.825335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813e21f-b1d5-440b-be17-2a7e3fcf34bc None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:08.862020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072961-9192-45a8-86a9-d2f0003c6173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:08.862666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072961-9192-45a8-86a9-d2f0003c6173 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:08.862944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072961-9192-45a8-86a9-d2f0003c6173 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:08.863246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072961-9192-45a8-86a9-d2f0003c6173 None admin] PATH_INFO: `/v3/users/3097aabd3eec4ef1aa088ab304f67bb0` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:08.864437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072961-9192-45a8-86a9-d2f0003c6173 None admin] RBAC: Authorizing `identity:get_user(user_id=3097aabd3eec4ef1aa088ab304f67bb0)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:08.865910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072961-9192-45a8-86a9-d2f0003c6173 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:08.867764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 120/238] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:08 2022] GET /identity/v3/users/3097aabd3eec4ef1aa088ab304f67bb0 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:08.873251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:08.940776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:08.982954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aade45-b7bf-4907-bd48-ae3ea68f481a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:09.018424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39582d-9c29-4307-b071-79542e7d3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:09.019005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39582d-9c29-4307-b071-79542e7d3673 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:09.019316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39582d-9c29-4307-b071-79542e7d3673 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:09.019592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39582d-9c29-4307-b071-79542e7d3673 None admin] PATH_INFO: `/v3/system/users/3097aabd3eec4ef1aa088ab304f67bb0/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:09.021024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39582d-9c29-4307-b071-79542e7d3673 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3097aabd3eec4ef1aa088ab304f67bb0, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:09.022424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39582d-9c29-4307-b071-79542e7d3673 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:09.033985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 119/239] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Oct 19 13:11:08 2022] PUT /identity/v3/system/users/3097aabd3eec4ef1aa088ab304f67bb0/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:10.716512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5a14-96db-447a-8ebe-1bf2058c8106 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:10.717057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5a14-96db-447a-8ebe-1bf2058c8106 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:10.717057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a5a14-96db-447a-8ebe-1bf2058c8106 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:10.718459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 121/240] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:10.724211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ce55-a1c0-4a9e-b3b4-0213e946a509 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:10.724594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ce55-a1c0-4a9e-b3b4-0213e946a509 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:10.724769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ce55-a1c0-4a9e-b3b4-0213e946a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:10.743052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d6f1ce55-a1c0-4a9e-b3b4-0213e946a509 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:10.744365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d6f1ce55-a1c0-4a9e-b3b4-0213e946a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:10.818530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 120/241] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:10.877433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8dfc7-d2c9-4180-9af4-6ad65b79fc21 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:10.877743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8dfc7-d2c9-4180-9af4-6ad65b79fc21 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:10.877988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8dfc7-d2c9-4180-9af4-6ad65b79fc21 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:10.879500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 122/242] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:10.884342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90578ae-4ef0-4482-88dd-fe3f89f11f01 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:10.884630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90578ae-4ef0-4482-88dd-fe3f89f11f01 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:10.884902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90578ae-4ef0-4482-88dd-fe3f89f11f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:10.903152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b90578ae-4ef0-4482-88dd-fe3f89f11f01 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:10.904328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b90578ae-4ef0-4482-88dd-fe3f89f11f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:10.955235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:10.973011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 121/243] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:11.090627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8dfc7-d2c9-4180-9af4-6ad65b79fc21 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.161162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d0308-11d9-4363-9554-e16c9c42e800 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.161755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d0308-11d9-4363-9554-e16c9c42e800 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.162257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d0308-11d9-4363-9554-e16c9c42e800 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.163879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 122/244] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:11.170702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209b39-2ed3-4a37-8de0-ecf583e676f8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.170994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209b39-2ed3-4a37-8de0-ecf583e676f8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.171300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209b39-2ed3-4a37-8de0-ecf583e676f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.174947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:11.193038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9f209b39-2ed3-4a37-8de0-ecf583e676f8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:11.194242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9f209b39-2ed3-4a37-8de0-ecf583e676f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:11.200278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8dfc7-d2c9-4180-9af4-6ad65b79fc21 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.235889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.236442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.236723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.237017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.238096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:11.239574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:11.241141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 123/245] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:11.241902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.265384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 123/246] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:11.266490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f209b39-2ed3-4a37-8de0-ecf583e676f8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.348738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9d34e-4bdc-4001-9cab-5094b94c0f09 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.371609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f209b39-2ed3-4a37-8de0-ecf583e676f8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.384057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.384809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.385090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.385483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.387931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:11.398408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:11.405040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:11.405933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:11.406738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 124/247] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:11.411708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.411911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.412510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.412791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.413058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] PATH_INFO: `/v3/groups` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.413682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:11.415166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:11.421018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:11.433749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 124/248] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Oct 19 13:11:11 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:11.534489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf17217-58e4-43db-bc88-365807d313e6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.539696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.572192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.573090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.573385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.573688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.574837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:11.575272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:11.577561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:11.590851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 125/249] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:11.596432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.651523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6771-dc35-4a05-afe8-71611c8455e2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.679484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:11.690320 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.691138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.691380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.691651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.707012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:11.712455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:11.713341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:11.714122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 125/250] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:11.719360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.721286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d05f0-982e-4dfb-b031-568821bc41d5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.764885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.765794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.766435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.767181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:11.767868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] PATH_INFO: `/v3/users/7d42f85ea6d44269b13b38887ceed45e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.769665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] RBAC: Authorizing `identity:get_user(user_id=7d42f85ea6d44269b13b38887ceed45e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:11.770945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:11.772891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 126/251] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:11 2022] GET /identity/v3/users/7d42f85ea6d44269b13b38887ceed45e => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:11.778774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.855891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b3c5-8406-45c4-9a27-a44d3c1c7d47 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.897960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.898919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.899488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.899989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.900877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] RBAC: Adding query filter params (name=member) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:11.901189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:11.901301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167937d4-d601-4645-99c9-1486c15da04c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:11.902603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:11.912023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 126/252] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:11.917460 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:11.946329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:11.947397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:11.947876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:11.948318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] PATH_INFO: `/v3/system/users/7d42f85ea6d44269b13b38887ceed45e/roles/b3a19dcb7d864ba8beaed2d22a226138` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:11.950068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7d42f85ea6d44269b13b38887ceed45e, role_id=b3a19dcb7d864ba8beaed2d22a226138)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:11.951677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:11.957032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:11.965637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 127/253] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Oct 19 13:11:11 2022] PUT /identity/v3/system/users/7d42f85ea6d44269b13b38887ceed45e/roles/b3a19dcb7d864ba8beaed2d22a226138 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:12.058486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:12.063941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b252a3-fe43-4b99-baf4-47e22ae04749 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:12.106395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2966-c817-4096-963f-8f498e784898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:12.106972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2966-c817-4096-963f-8f498e784898 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:12.107285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2966-c817-4096-963f-8f498e784898 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:12.107569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2966-c817-4096-963f-8f498e784898 None admin] PATH_INFO: `/v3/users/3097aabd3eec4ef1aa088ab304f67bb0` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:12.108788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2966-c817-4096-963f-8f498e784898 None admin] RBAC: Authorizing `identity:get_user(user_id=3097aabd3eec4ef1aa088ab304f67bb0)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:12.110886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2966-c817-4096-963f-8f498e784898 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:12.112932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 127/254] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:11 2022] GET /identity/v3/users/3097aabd3eec4ef1aa088ab304f67bb0 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:12.118992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:12.233418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebecc-d25f-47b5-9d4b-ceefbdb5cd14 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:12.271445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c68b3-061e-4201-960f-4d8264460890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:12.272069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c68b3-061e-4201-960f-4d8264460890 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:12.272348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c68b3-061e-4201-960f-4d8264460890 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:12.272620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c68b3-061e-4201-960f-4d8264460890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:12.273425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c68b3-061e-4201-960f-4d8264460890 None admin] RBAC: Adding query filter params (role.id=b0eca5323ad04e739e90f2372d36e579, user.id=3097aabd3eec4ef1aa088ab304f67bb0, scope.system=all) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:12.273739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c68b3-061e-4201-960f-4d8264460890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:12.275296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c68b3-061e-4201-960f-4d8264460890 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:12.288495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 128/255] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Oct 19 13:11:12 2022] GET /identity/v3/role_assignments?user.id=3097aabd3eec4ef1aa088ab304f67bb0&scope.system=all&role.id=b0eca5323ad04e739e90f2372d36e579 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:13.978929 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c920f-856e-4b13-a897-a8cc331a970c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:13.979494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c920f-856e-4b13-a897-a8cc331a970c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:13.979572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c920f-856e-4b13-a897-a8cc331a970c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:13.981128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 128/256] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:13.987350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0452be-eede-47d2-927e-c6089df790f5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:13.987859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0452be-eede-47d2-927e-c6089df790f5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:13.987932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0452be-eede-47d2-927e-c6089df790f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.016319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3f0452be-eede-47d2-927e-c6089df790f5 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:14.017632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3f0452be-eede-47d2-927e-c6089df790f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:14.089139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 129/257] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 19 13:11:14.144858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e424f-eb55-4f4c-b026-bde25642e26d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.145165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e424f-eb55-4f4c-b026-bde25642e26d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.145422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e424f-eb55-4f4c-b026-bde25642e26d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.147127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 129/258] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:14.152615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8386ce-84c4-4d46-bf49-5e4977ddae25 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.152898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8386ce-84c4-4d46-bf49-5e4977ddae25 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.153170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8386ce-84c4-4d46-bf49-5e4977ddae25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.171575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:14.188119 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9b8386ce-84c4-4d46-bf49-5e4977ddae25 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:14.190441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9b8386ce-84c4-4d46-bf49-5e4977ddae25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:14.201452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 130/259] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 13:11:14.421725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e424f-eb55-4f4c-b026-bde25642e26d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.437169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e424f-eb55-4f4c-b026-bde25642e26d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.442306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.443216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.443720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.444192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.464027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:14.469241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:14.470715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:14.471556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:14.473878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 130/260] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Oct 19 13:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:14.479707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8386ce-84c4-4d46-bf49-5e4977ddae25 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.494317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8386ce-84c4-4d46-bf49-5e4977ddae25 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.503224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.503839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.504121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.504394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.505073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:14.505375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:14.508124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:11:14.508124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:11:14.508124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:11:14.509045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:14.523942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 131/261] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:14.529489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.544162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5566e0-9a43-4a8b-bc2a-68ae03b31351 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.554389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.555315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.555805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.556328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.569688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:14.571854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:11:14.571854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:11:14.571854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:11:14.573445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:14.576417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 131/262] 10.222.0.46 () {56 vars in 1201 bytes} [Wed Oct 19 13:11:14 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:14.581533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.597663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107ddc-bf9e-4beb-a2fb-ec98c903c841 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.605189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.605864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.606206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.606484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.607834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:14.610059 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:14.612355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 132/263] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Oct 19 13:11:14 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:14.618174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.632308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13564978-2d67-4270-862a-fec17fcf6fba admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.643243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4f0ef-e1b2-4c5d-b084-bacea2779c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.644234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4f0ef-e1b2-4c5d-b084-bacea2779c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.644723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4f0ef-e1b2-4c5d-b084-bacea2779c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.645219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4f0ef-e1b2-4c5d-b084-bacea2779c10 admin admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.652445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4f0ef-e1b2-4c5d-b084-bacea2779c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8571e31058db4740b3a460a83172d371, group_id=8d8df23cc00149a0981b24888c5d2c3c, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:14.653804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-dae4f0ef-e1b2-4c5d-b084-bacea2779c10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:11:14.653804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:11:14.653804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:11:14.656287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4f0ef-e1b2-4c5d-b084-bacea2779c10 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:14.687912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 132/264] 10.222.0.46 () {58 vars in 1463 bytes} [Wed Oct 19 13:11:14 2022] PUT /identity/v3/projects/8571e31058db4740b3a460a83172d371/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:14.756692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.768681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fd17-a286-4187-ac4b-b517bbd348c6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.841024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.841834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.842126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.845990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.864661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b089c-fc7c-4a39-a614-8f4d52af66d1 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.865502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b089c-fc7c-4a39-a614-8f4d52af66d1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.866066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b089c-fc7c-4a39-a614-8f4d52af66d1 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.867725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 133/265] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:14.873985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:14.879951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b286c3-d335-4d3a-919d-2452ef9ab07b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:14.880229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:14.881114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:14.882323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 133/266] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Oct 19 13:11:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:14.883656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b286c3-d335-4d3a-919d-2452ef9ab07b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.884151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b286c3-d335-4d3a-919d-2452ef9ab07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.897915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.912600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617f5a7-431c-447f-a5e3-79bc6a76fb4f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.915789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-12b286c3-d335-4d3a-919d-2452ef9ab07b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:14.917416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-12b286c3-d335-4d3a-919d-2452ef9ab07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:14.931125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.931125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.931125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.931125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.931543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:14.931543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:14.931543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:14.958360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 134/267] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Oct 19 13:11:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:14.963146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:14.976469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa64a7-e282-4d4f-9ac5-4bf9c992ea8b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:14.990275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:14.990894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:14.991207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:14.991475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:14.992609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:14.993631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:11:14.993631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:11:14.993631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:11:14.994827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:14.996421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 135/268] 10.222.0.46 () {56 vars in 1201 bytes} [Wed Oct 19 13:11:14 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:15.018808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.029960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95a35d-008a-4f6e-9453-652b71329064 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.036106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:15.036762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.037045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.037321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.038535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:15.040674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:15.043360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 136/269] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Oct 19 13:11:15 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:15.051894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.058350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 134/270] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:15.069283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f803dda-90f0-4687-8975-f08d22e9e9a8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.075120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8fa5f-4a98-4a36-85f3-9817aa8dcb2e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.075423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8fa5f-4a98-4a36-85f3-9817aa8dcb2e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.075751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8fa5f-4a98-4a36-85f3-9817aa8dcb2e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.077298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 135/271] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:15.077806 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:15.078471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.078749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.079018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/c2a5de5e2b0745e89cd777db9a2d1099` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.084227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dabca-a6f2-4ae3-bcb4-9f86b93081c2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.084508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dabca-a6f2-4ae3-bcb4-9f86b93081c2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.084784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dabca-a6f2-4ae3-bcb4-9f86b93081c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.085399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8571e31058db4740b3a460a83172d371, group_id=8d8df23cc00149a0981b24888c5d2c3c, role_id=c2a5de5e2b0745e89cd777db9a2d1099)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:15.086658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:11:15.086658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:11:15.086658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:11:15.088997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:15.107041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 137/272] 10.222.0.46 () {58 vars in 1463 bytes} [Wed Oct 19 13:11:15 2022] PUT /identity/v3/projects/8571e31058db4740b3a460a83172d371/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/c2a5de5e2b0745e89cd777db9a2d1099 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:11:15.120316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-402dabca-a6f2-4ae3-bcb4-9f86b93081c2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:15.121565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-402dabca-a6f2-4ae3-bcb4-9f86b93081c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:15.208957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 136/273] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 19 13:11:15.654882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.665921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0dff4d-4ff2-4d57-a39a-55aa0bcc7fe2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.684121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:15.685108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.685595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.686099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.696741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dabca-a6f2-4ae3-bcb4-9f86b93081c2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.702999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:15.708450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:15.709341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:15.710121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:15.712417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 138/274] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Oct 19 13:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:15.719326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.724153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:15.732908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd385fd-bf15-40d4-9310-43ed14d60e96 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.751859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:15.752499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.752788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.753070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.753756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:15.754064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:15.755932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:15.766999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 139/275] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:15.772791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.786713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ac82-cc38-4583-8b35-a268024e7026 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.808991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:15.809653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.809938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.810213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.811474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:15.813904 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:15.820872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 140/276] 10.222.0.46 () {56 vars in 1201 bytes} [Wed Oct 19 13:11:15 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:15.827101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.844467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da757ed-808b-4c26-a68b-feadc640d7d2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.859944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:15.860635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.860921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.861239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.867836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:15.875102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:15.875102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 141/277] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Oct 19 13:11:15 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:15.878997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:15.896884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75556844-862f-43d2-a884-5799572ea134 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.916936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:15.917536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:15.917819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:15.918098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:15.924947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cdf1e43e04850ab133c8752006c72, group_id=8d8df23cc00149a0981b24888c5d2c3c, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:15.927842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:15.956290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dabca-a6f2-4ae3-bcb4-9f86b93081c2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:15.974545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 142/278] 10.222.0.46 () {58 vars in 1463 bytes} [Wed Oct 19 13:11:15 2022] PUT /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:16.045360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec0b8c-8ee3-4aa9-852d-79d34c7aba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:16.046377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec0b8c-8ee3-4aa9-852d-79d34c7aba59 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:16.046869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec0b8c-8ee3-4aa9-852d-79d34c7aba59 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:16.047361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec0b8c-8ee3-4aa9-852d-79d34c7aba59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:16.064715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec0b8c-8ee3-4aa9-852d-79d34c7aba59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-81ec0b8c-8ee3-4aa9-852d-79d34c7aba59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:16.077174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:16.078100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 19 13:11:16.078897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:16.082144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 137/279] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:16.088077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:16.231557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:16.299923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca2b5d-d30e-4ebb-adf4-d884cf1da9c1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:16.346173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ceaf-c043-48d4-9716-48dc97d0645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:16.346842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ceaf-c043-48d4-9716-48dc97d0645c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:16.347163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ceaf-c043-48d4-9716-48dc97d0645c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:16.347442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ceaf-c043-48d4-9716-48dc97d0645c None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:16.348149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ceaf-c043-48d4-9716-48dc97d0645c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:16.348439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ceaf-c043-48d4-9716-48dc97d0645c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:16.349856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ceaf-c043-48d4-9716-48dc97d0645c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:16.362687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 143/280] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:16.366208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af275-2f8e-49cb-bed0-ee14f0e4e9dc None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:16.366706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af275-2f8e-49cb-bed0-ee14f0e4e9dc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:16.367205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af275-2f8e-49cb-bed0-ee14f0e4e9dc None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:16.368754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 138/281] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:16.373929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5a8db-6a0b-400f-8529-a8c6f93bc462 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:16.374262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5af275-2f8e-49cb-bed0-ee14f0e4e9dc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:16.374430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5a8db-6a0b-400f-8529-a8c6f93bc462 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:16.374697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5a8db-6a0b-400f-8529-a8c6f93bc462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:16.405810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-14f5a8db-6a0b-400f-8529-a8c6f93bc462 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:16.408463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-14f5a8db-6a0b-400f-8529-a8c6f93bc462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:16.516306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:16.539548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 144/282] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 13:11:16.584715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5af275-2f8e-49cb-bed0-ee14f0e4e9dc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:16.649698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:16.650347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:16.650627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:16.650902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] PATH_INFO: `/v3/users/7d42f85ea6d44269b13b38887ceed45e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:16.652111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] RBAC: Authorizing `identity:get_user(user_id=7d42f85ea6d44269b13b38887ceed45e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:16.653584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:16.655504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 139/283] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:11:16 2022] GET /identity/v3/users/7d42f85ea6d44269b13b38887ceed45e => generated 293 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:16.661402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5a8db-6a0b-400f-8529-a8c6f93bc462 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:16.775559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:16.823216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5a8db-6a0b-400f-8529-a8c6f93bc462 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:16.872701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:16.873339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:16.873621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:16.873891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:16.874631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] RBAC: Adding query filter params (role.id=b3a19dcb7d864ba8beaed2d22a226138, user.id=7d42f85ea6d44269b13b38887ceed45e, scope.system=all) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:16.874944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:16.877005 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:16.894890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 145/284] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Oct 19 13:11:16 2022] GET /identity/v3/role_assignments?user.id=7d42f85ea6d44269b13b38887ceed45e&scope.system=all&role.id=b3a19dcb7d864ba8beaed2d22a226138 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:17.080670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:17.091757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e3381-82b9-4cbf-a358-c16f4cfac0cf None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:17.099114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:17.099756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:17.100038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:17.100312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:17.116065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:17.121073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:17.121955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:17.122746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 140/285] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Oct 19 13:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:17.130008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:17.145145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8b873-12b3-4c88-bcda-c3c6561f0f12 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:17.149631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:17.150251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:17.150534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:17.150811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:17.151521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:17.151829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:17.153437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:17.162927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 146/286] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Oct 19 13:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:17.174340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:17.196348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c754-d516-4848-ab85-dd89b58a4e7f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:17.203763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:17.204442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:17.204723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:17.204998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:17.206183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:17.208173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:17.210110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 141/287] 10.222.0.46 () {56 vars in 1201 bytes} [Wed Oct 19 13:11:17 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:17.215718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:17.226549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db0c71-f4c5-46c6-8375-ed6a7821585f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:17.235249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e1e0a-99f9-4791-8c6a-814a6a550585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:17.236467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e1e0a-99f9-4791-8c6a-814a6a550585 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:17.236752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e1e0a-99f9-4791-8c6a-814a6a550585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:17.237038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e1e0a-99f9-4791-8c6a-814a6a550585 admin admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:17.238195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e1e0a-99f9-4791-8c6a-814a6a550585 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:17.240329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e1e0a-99f9-4791-8c6a-814a6a550585 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:17.241976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 147/288] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Oct 19 13:11:17 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:17.247872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:17.259092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304938a-0f05-4c07-a277-214738e02c90 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:17.263636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cfc51-05b6-4d97-b086-7479210e2c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:17.264295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cfc51-05b6-4d97-b086-7479210e2c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:17.264575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cfc51-05b6-4d97-b086-7479210e2c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:17.264853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cfc51-05b6-4d97-b086-7479210e2c24 admin admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/c2a5de5e2b0745e89cd777db9a2d1099` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:17.267113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cfc51-05b6-4d97-b086-7479210e2c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cdf1e43e04850ab133c8752006c72, group_id=8d8df23cc00149a0981b24888c5d2c3c, role_id=c2a5de5e2b0745e89cd777db9a2d1099)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:17.269802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cfc51-05b6-4d97-b086-7479210e2c24 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:17.288937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 142/289] 10.222.0.46 () {58 vars in 1463 bytes} [Wed Oct 19 13:11:17 2022] PUT /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72/groups/8d8df23cc00149a0981b24888c5d2c3c/roles/c2a5de5e2b0745e89cd777db9a2d1099 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:17.655364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6bb4-4662-4fd9-a053-c82c772908fb None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:17.656089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6bb4-4662-4fd9-a053-c82c772908fb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:17.656579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6bb4-4662-4fd9-a053-c82c772908fb None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:17.659021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 148/290] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:17.664892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e45c-9760-4763-bd58-9a5fc21ed3f0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:17.665444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e45c-9760-4763-bd58-9a5fc21ed3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:17.665958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e45c-9760-4763-bd58-9a5fc21ed3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:17.688065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7a62e45c-9760-4763-bd58-9a5fc21ed3f0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:17.690380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7a62e45c-9760-4763-bd58-9a5fc21ed3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:17.768902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 143/291] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 19 13:11:18.322236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6bb4-4662-4fd9-a053-c82c772908fb None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:18.340748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6bb4-4662-4fd9-a053-c82c772908fb None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:18.345674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:18.346568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.347052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.347573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.359755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:18.365547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:18.366414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:18.368975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:18.375195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 149/292] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:18.378095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62e45c-9760-4763-bd58-9a5fc21ed3f0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:18.388677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62e45c-9760-4763-bd58-9a5fc21ed3f0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:18.394783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:18.395823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.396333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.396833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.397739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:18.398258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:18.399649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:11:18.399649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:11:18.399649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:11:18.401013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:18.411483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 144/293] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Oct 19 13:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:18.417830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:18.429309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a951db-5f89-4511-8c42-144a881b0645 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:18.434502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:18.435409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.435901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.436379 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] PATH_INFO: `/v3/groups/7204ed7109a441fe998b54edaa388072` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.443981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] RBAC: Authorizing `identity:get_group(group_id=7204ed7109a441fe998b54edaa388072)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:18.447898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:18.451122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 150/294] 10.222.0.46 () {56 vars in 1201 bytes} [Wed Oct 19 13:11:18 2022] GET /identity/v3/groups/7204ed7109a441fe998b54edaa388072 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:18.456162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:18.468758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f48d1-57fe-4fcc-855d-db39ab732599 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:18.474679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf4b3e-82c5-456e-ac36-0530f1a3f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:18.475793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf4b3e-82c5-456e-ac36-0530f1a3f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.476330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf4b3e-82c5-456e-ac36-0530f1a3f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.476814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf4b3e-82c5-456e-ac36-0530f1a3f1d0 admin admin] PATH_INFO: `/v3/projects/efe3aef313a94867b11cab52bd11b924` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.478488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf4b3e-82c5-456e-ac36-0530f1a3f1d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=efe3aef313a94867b11cab52bd11b924)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:18.480630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf4b3e-82c5-456e-ac36-0530f1a3f1d0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:18.483976 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 145/295] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Oct 19 13:11:18 2022] GET /identity/v3/projects/efe3aef313a94867b11cab52bd11b924 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:18.489719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:18.502412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242bb02-935d-4cbb-aedb-e12d4d8945b0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:18.507582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11586ce5-ab49-4e85-8552-f6dd0cad459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:18.508554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586ce5-ab49-4e85-8552-f6dd0cad459b admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.509083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586ce5-ab49-4e85-8552-f6dd0cad459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.509561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586ce5-ab49-4e85-8552-f6dd0cad459b admin admin] PATH_INFO: `/v3/projects/efe3aef313a94867b11cab52bd11b924/groups/7204ed7109a441fe998b54edaa388072/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.511746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4905e6a-701f-40b3-92df-bd0246a32b71 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.512331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4905e6a-701f-40b3-92df-bd0246a32b71 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.512879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4905e6a-701f-40b3-92df-bd0246a32b71 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.513291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11586ce5-ab49-4e85-8552-f6dd0cad459b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe3aef313a94867b11cab52bd11b924, group_id=7204ed7109a441fe998b54edaa388072, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:18.515451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 146/296] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:18.516093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11586ce5-ab49-4e85-8552-f6dd0cad459b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:18.517114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52bea-e367-4f15-bd63-6c40cee5a552 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.517632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52bea-e367-4f15-bd63-6c40cee5a552 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.518118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52bea-e367-4f15-bd63-6c40cee5a552 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.520210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 147/297] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:18.524186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c38b-64bf-4624-9ea9-c934ea13fd9d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.524727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c38b-64bf-4624-9ea9-c934ea13fd9d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.525299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c38b-64bf-4624-9ea9-c934ea13fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.541509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 151/298] 10.222.0.46 () {58 vars in 1463 bytes} [Wed Oct 19 13:11:18 2022] PUT /identity/v3/projects/efe3aef313a94867b11cab52bd11b924/groups/7204ed7109a441fe998b54edaa388072/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:18.542807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7699-0616-42c4-9731-6b2c057e620f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.543189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7699-0616-42c4-9731-6b2c057e620f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.543460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc7699-0616-42c4-9731-6b2c057e620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.564629 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5b51c38b-64bf-4624-9ea9-c934ea13fd9d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:18.565002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-26cc7699-0616-42c4-9731-6b2c057e620f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:18.565879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5b51c38b-64bf-4624-9ea9-c934ea13fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:18.566277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-26cc7699-0616-42c4-9731-6b2c057e620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:18.633053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:18.702287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 152/299] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:18.703630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 148/300] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:18.835810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b2ac-14b1-48a7-ab63-dac2bf8ac5aa None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.836160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b2ac-14b1-48a7-ab63-dac2bf8ac5aa None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.836354 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b2ac-14b1-48a7-ab63-dac2bf8ac5aa None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.837706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 153/301] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:18.843563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf3ea-c749-49c3-b282-a0f2ddb416b9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:18.843850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf3ea-c749-49c3-b282-a0f2ddb416b9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:18.844128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf3ea-c749-49c3-b282-a0f2ddb416b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:18.865543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-497bf3ea-c749-49c3-b282-a0f2ddb416b9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:18.866727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-497bf3ea-c749-49c3-b282-a0f2ddb416b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:18.952474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 149/302] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:19.050151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b2ac-14b1-48a7-ab63-dac2bf8ac5aa None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.053356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:19.151872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf3ea-c749-49c3-b282-a0f2ddb416b9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.169676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b2ac-14b1-48a7-ab63-dac2bf8ac5aa None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:19.207190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:19.208258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:19.209019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:19.209442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:19.223017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:19.228567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:19.229674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:19.230677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:19.234979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 154/303] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:19.242012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.336811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:19.339276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf3ea-c749-49c3-b282-a0f2ddb416b9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:19.341315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:19.389380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:19.390696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:19.391190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:19.391613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:19.397534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a666c6-7fae-4823-9742-533e0ec5e4d7 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:19.403015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:19.409411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:19.410308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:19.411542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:19.413853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 150/304] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:19.414851 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.448766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:19.449393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:19.449730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:19.450012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:19.450754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:19.451070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:19.452483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:19.461827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 155/305] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:19.462519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.544173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c969ab-4e4c-48b5-83b2-d80c3b6b90f8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:19.602581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5628-c03e-4650-a75c-a8c0352686ca None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:19.603252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:19.603914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:19.604197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:19.604476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:19.627014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:19.632098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:19.633059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:19.633856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 151/306] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:19.634518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.637470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:19.651615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:19.652240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:19.652524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:19.652799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:19.653474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:19.653784 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:19.655213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:19.669168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:19.670578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 156/307] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:19.671565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.771564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc62c5-6558-45e0-b641-dfe956918010 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:19.797278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a43e3-e97d-4520-b5ad-5df68d7c9919 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:19.813889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:19.815207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:19.815747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:19.817752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:19.842774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:19.843427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:19.843710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:19.843987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:19.844665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:19.845531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:19.849666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:19.859032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 157/308] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:19.860118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:19.913986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:19.915958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:19.926961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:19.947279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:19.998073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da232-7eb8-4cb4-b05f-d2818a2a4ca9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.043353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.044190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.044375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 152/309] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:20.044830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.045223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.045461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.128828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.130359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:20.165576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2acee9-fb97-46e9-adde-b4ff72672204 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.185322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:20.205262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:20.222515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679821e-3499-4ee1-8cf3-b21183734f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.223173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679821e-3499-4ee1-8cf3-b21183734f9d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.223456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679821e-3499-4ee1-8cf3-b21183734f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.223729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679821e-3499-4ee1-8cf3-b21183734f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.254783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 158/310] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:20.255916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.309117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679821e-3499-4ee1-8cf3-b21183734f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.310990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679821e-3499-4ee1-8cf3-b21183734f9d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:20.379319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f8ea-b2f7-4370-9b47-22832caf7c19 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.422506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903542b8-9a09-4222-abbe-f502ae53f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.423910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903542b8-9a09-4222-abbe-f502ae53f05c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.424231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903542b8-9a09-4222-abbe-f502ae53f05c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.424576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903542b8-9a09-4222-abbe-f502ae53f05c None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.425913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903542b8-9a09-4222-abbe-f502ae53f05c None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.427750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903542b8-9a09-4222-abbe-f502ae53f05c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:20.429574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 159/311] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:20.431116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49c9d-72a9-4910-88c3-bdb3c561ed21 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.431465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49c9d-72a9-4910-88c3-bdb3c561ed21 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.431747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49c9d-72a9-4910-88c3-bdb3c561ed21 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.433576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 160/312] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:20.434318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d49c9d-72a9-4910-88c3-bdb3c561ed21 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.446904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 153/313] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:20.452787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d7df4-9814-4e0f-aa72-110e63171011 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.452787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d7df4-9814-4e0f-aa72-110e63171011 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.452787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d7df4-9814-4e0f-aa72-110e63171011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.462323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:20.472222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-316d7df4-9814-4e0f-aa72-110e63171011 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:20.473442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-316d7df4-9814-4e0f-aa72-110e63171011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:20.493730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:20.554702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 154/314] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:20.555627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d7df4-9814-4e0f-aa72-110e63171011 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.573986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d49c9d-72a9-4910-88c3-bdb3c561ed21 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.612820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.613163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.613445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.613723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] PATH_INFO: `/v3/projects/8571e31058db4740b3a460a83172d371` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.615194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] RBAC: Authorizing `identity:get_project(project_id=8571e31058db4740b3a460a83172d371)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.616698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:20.618409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 161/315] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/projects/8571e31058db4740b3a460a83172d371 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:20.619203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.692700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d7df4-9814-4e0f-aa72-110e63171011 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.727521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:20.737915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.738882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.739464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.739806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.741054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.743195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:20.744650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86feb8-8f4a-417a-8e5b-d6133387f09f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.745227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 155/316] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:20.746318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.778435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:20.792267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.792911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.793193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.793464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.795948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.797658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:20.801196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 162/317] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:20.802174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.890446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3f7d8-adfe-439a-9d46-1e35e0c25b1d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.929297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.930306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.930791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.931205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.932425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.933967 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:20.935660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 156/318] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:20.936426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:20.937279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcf0d8-c872-4527-bfdb-023db097d985 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:20.994177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:20.994789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:20.995065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:20.995410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:20.996139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] RBAC: Adding query filter params (group.id=8d8df23cc00149a0981b24888c5d2c3c, role.id=b0eca5323ad04e739e90f2372d36e579, scope.project.id=8571e31058db4740b3a460a83172d371) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:20.996448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:20.997887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:21.004420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 163/319] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/role_assignments?group.id=8d8df23cc00149a0981b24888c5d2c3c&scope.project.id=8571e31058db4740b3a460a83172d371&role.id=b0eca5323ad04e739e90f2372d36e579 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:21.005268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:21.031315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:21.053366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:21.070868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf787-ed13-41ef-a34a-8eff6e407035 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:21.119238 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:21.120307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.120591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.121020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.122348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:21.124702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:21.127801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 157/320] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Oct 19 13:11:20 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:21.128992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:21.146181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666162f-7d9c-4584-9c67-b82880b7b672 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:21.201188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:21.201848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.202123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.202389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.223125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:21.226176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:21.227129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 164/321] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:21.230179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:21.279818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342ce9a-5993-41a8-8a06-55b005dbea22 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:21.326473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:21.327546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.328035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.328548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.329436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:21.329729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] RBAC: Adding query filter params (group.id=8d8df23cc00149a0981b24888c5d2c3c, role.id=c2a5de5e2b0745e89cd777db9a2d1099, scope.project.id=8571e31058db4740b3a460a83172d371) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:21.330155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:21.334556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:21.341544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 158/322] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Oct 19 13:11:21 2022] GET /identity/v3/role_assignments?group.id=8d8df23cc00149a0981b24888c5d2c3c&scope.project.id=8571e31058db4740b3a460a83172d371&role.id=c2a5de5e2b0745e89cd777db9a2d1099 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:21.342346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:21.364889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37e5a-9415-4202-85bd-27f1003a30f8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:21.375328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:21.412663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8ff70-62a9-4b71-8b19-e1f48a7fb1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:21.413211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ff70-62a9-4b71-8b19-e1f48a7fb1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.413480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ff70-62a9-4b71-8b19-e1f48a7fb1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.413753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ff70-62a9-4b71-8b19-e1f48a7fb1c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.414505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8ff70-62a9-4b71-8b19-e1f48a7fb1c1 None admin] RBAC: Adding query filter params (group.id=8d8df23cc00149a0981b24888c5d2c3c, role.id=b0eca5323ad04e739e90f2372d36e579, scope.project.id=8d3cdf1e43e04850ab133c8752006c72) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:21.414820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8ff70-62a9-4b71-8b19-e1f48a7fb1c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:21.416395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8ff70-62a9-4b71-8b19-e1f48a7fb1c1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:21.423609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 165/323] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Oct 19 13:11:21 2022] GET /identity/v3/role_assignments?group.id=8d8df23cc00149a0981b24888c5d2c3c&scope.project.id=8d3cdf1e43e04850ab133c8752006c72&role.id=b0eca5323ad04e739e90f2372d36e579 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:21.424979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8dfb-ecfb-4ad5-937f-711b8abc8618 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.425356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8dfb-ecfb-4ad5-937f-711b8abc8618 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.425719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8dfb-ecfb-4ad5-937f-711b8abc8618 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.427388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 166/324] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:21.433220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131002-f468-411c-bc6b-3d67112d504c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.433568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131002-f468-411c-bc6b-3d67112d504c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.433923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131002-f468-411c-bc6b-3d67112d504c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.475366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-76131002-f468-411c-bc6b-3d67112d504c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:21.475366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-76131002-f468-411c-bc6b-3d67112d504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:21.483717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ee8d-d6da-4c36-ab73-9d0e7af45331 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:21.539746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:21.540389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.540665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.540932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.541626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:21.541939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:21.543420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:21.555920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 159/325] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:21.561403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:21.571624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 167/326] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:21.664853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:21.686069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa67546-4b29-4df4-a1b3-3db6dfbdee98 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:21.723105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:21.724067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:21.724353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:21.724630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:21.795568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:21.797038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:21.850140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131002-f468-411c-bc6b-3d67112d504c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:21.887436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:21.913513 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 160/327] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 19 13:11:21.919833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:21.932717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:21.971038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131002-f468-411c-bc6b-3d67112d504c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.012608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.013257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.013653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.013932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.026217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:22.031155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:22.032072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:22.033602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 168/328] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:22.039459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:22.042294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453f17-15b1-4fa0-b7ab-3aa33da21f32 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.092100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.092100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.092100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.092100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] PATH_INFO: `/v3/projects/8d3cdf1e43e04850ab133c8752006c72` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.092465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] RBAC: Authorizing `identity:get_project(project_id=8d3cdf1e43e04850ab133c8752006c72)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.093785 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.097972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 161/329] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:21 2022] GET /identity/v3/projects/8d3cdf1e43e04850ab133c8752006c72 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:22.102491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:22.155719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:22.160030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225892f-899e-4141-bd81-a4ce8140c1ba None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.189529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:22.195813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.196425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.196703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.196973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.197636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:22.197937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.199329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.208356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 169/330] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:22.211511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6c40-dab6-4666-ac0a-6b5c3b26f31a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.213885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:22.244157 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.244872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.245152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.245420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] PATH_INFO: `/v3/groups/8d8df23cc00149a0981b24888c5d2c3c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.246511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] RBAC: Authorizing `identity:get_group(group_id=8d8df23cc00149a0981b24888c5d2c3c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.247981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.249538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 162/331] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Oct 19 13:11:22 2022] GET /identity/v3/groups/8d8df23cc00149a0981b24888c5d2c3c => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:22.255712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:22.310886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cb6cf-0d88-40f8-b319-9fa877a3f257 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.344809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.345429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.345717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.345990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.352511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc01b-f090-44bd-9740-242a40a93723 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.368499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:22.385668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.386275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.386556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.386833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.387595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] RBAC: Adding query filter params (group.id=8d8df23cc00149a0981b24888c5d2c3c, role.id=c2a5de5e2b0745e89cd777db9a2d1099, scope.project.id=8d3cdf1e43e04850ab133c8752006c72) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:22.387904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.389361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.395770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 163/332] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Oct 19 13:11:22 2022] GET /identity/v3/role_assignments?group.id=8d8df23cc00149a0981b24888c5d2c3c&scope.project.id=8d3cdf1e43e04850ab133c8752006c72&role.id=c2a5de5e2b0745e89cd777db9a2d1099 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:22.406231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:22.416942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.418518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.522561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 170/333] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:22.528378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:22.633115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aa9f7-b0f9-4747-94a2-60aa522c1e28 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.667058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.667704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.667983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.668259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] PATH_INFO: `/v3/projects/efe3aef313a94867b11cab52bd11b924` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.669385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] RBAC: Authorizing `identity:get_project(project_id=efe3aef313a94867b11cab52bd11b924)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.670859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.672533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 164/334] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:11:22 2022] GET /identity/v3/projects/efe3aef313a94867b11cab52bd11b924 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:22.678098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:22.768248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:22.777617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dac00-5f1c-46ac-af1b-a94ec481579d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.810411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf3b07-020a-43d0-9b8e-186eb9e87fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.811030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3b07-020a-43d0-9b8e-186eb9e87fed None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.811338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3b07-020a-43d0-9b8e-186eb9e87fed None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.811611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3b07-020a-43d0-9b8e-186eb9e87fed None admin] PATH_INFO: `/v3/groups/7204ed7109a441fe998b54edaa388072` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.812706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf3b07-020a-43d0-9b8e-186eb9e87fed None admin] RBAC: Authorizing `identity:get_group(group_id=7204ed7109a441fe998b54edaa388072)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.814551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf3b07-020a-43d0-9b8e-186eb9e87fed None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.816182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 171/335] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Oct 19 13:11:22 2022] GET /identity/v3/groups/7204ed7109a441fe998b54edaa388072 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:22.822089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:22.870246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:22.918416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90019a83-80ac-49c5-a5f2-049147008202 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:22.950360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b439-4931-4a20-b1a7-a66ffa5addc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:22.950948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b439-4931-4a20-b1a7-a66ffa5addc3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:22.951252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b439-4931-4a20-b1a7-a66ffa5addc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:22.951527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b439-4931-4a20-b1a7-a66ffa5addc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:22.952247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680b439-4931-4a20-b1a7-a66ffa5addc3 None admin] RBAC: Adding query filter params (group.id=7204ed7109a441fe998b54edaa388072, role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=efe3aef313a94867b11cab52bd11b924) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:22.952556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680b439-4931-4a20-b1a7-a66ffa5addc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:22.953971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680b439-4931-4a20-b1a7-a66ffa5addc3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:22.960108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 165/336] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Oct 19 13:11:22 2022] GET /identity/v3/role_assignments?group.id=7204ed7109a441fe998b54edaa388072&scope.project.id=efe3aef313a94867b11cab52bd11b924&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:25.533073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834f28-ceb7-495f-b385-d6d08d773638 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:25.533582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834f28-ceb7-495f-b385-d6d08d773638 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:25.533582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834f28-ceb7-495f-b385-d6d08d773638 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:25.535143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 172/337] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:25.541234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea0618-4f84-41eb-bf71-8c149ac8d891 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:25.541854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea0618-4f84-41eb-bf71-8c149ac8d891 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:25.541854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea0618-4f84-41eb-bf71-8c149ac8d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:25.570828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-67ea0618-4f84-41eb-bf71-8c149ac8d891 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:25.572188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-67ea0618-4f84-41eb-bf71-8c149ac8d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:25.646122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2491-64d5-4e3a-93e7-fb813f48fcd2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:25.646454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2491-64d5-4e3a-93e7-fb813f48fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:25.646682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2491-64d5-4e3a-93e7-fb813f48fcd2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:25.648358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 173/338] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:25.654298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4ee0-5872-425e-898f-3708057cf21f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:25.654582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4ee0-5872-425e-898f-3708057cf21f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:25.654859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f4ee0-5872-425e-898f-3708057cf21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:25.676889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 166/339] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:25.684145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4d6f4ee0-5872-425e-898f-3708057cf21f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:25.685368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4d6f4ee0-5872-425e-898f-3708057cf21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:25.781486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 174/340] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:25.954832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea0618-4f84-41eb-bf71-8c149ac8d891 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:25.966528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc17a-0c2c-436a-9cce-1e8f3fe990a6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:25.966814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc17a-0c2c-436a-9cce-1e8f3fe990a6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:25.967104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc17a-0c2c-436a-9cce-1e8f3fe990a6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:25.971965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 175/341] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:25.977081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742c09-da7d-4486-aac7-216b793d9588 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:25.977371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742c09-da7d-4486-aac7-216b793d9588 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:25.977649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e742c09-da7d-4486-aac7-216b793d9588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.016071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3e742c09-da7d-4486-aac7-216b793d9588 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:26.018516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3e742c09-da7d-4486-aac7-216b793d9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:26.036487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:26.138040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea0618-4f84-41eb-bf71-8c149ac8d891 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.152878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 176/342] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:26.153731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742c09-da7d-4486-aac7-216b793d9588 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:26.183921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:26.220575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:26.221142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.221425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.221700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.240129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:26.241605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:26.272413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:26.273407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:26.274249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:26.274249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:26.274249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:26.275242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 167/343] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:26.279408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:26.297611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e742c09-da7d-4486-aac7-216b793d9588 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.338065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:26.339071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.340298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.341324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.363861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:26.365679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:26.391753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:26.393234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:26.394095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:26.394095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:26.394095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:26.401124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 177/344] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:26.404554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:26.448645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:26.457993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5abe-1701-4640-8883-23163b16ce87 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.513645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e04541-e260-470b-9158-53225e777a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:26.514772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e04541-e260-470b-9158-53225e777a44 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.515276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e04541-e260-470b-9158-53225e777a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.515708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e04541-e260-470b-9158-53225e777a44 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.516510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e04541-e260-470b-9158-53225e777a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:26.517746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e04541-e260-470b-9158-53225e777a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:26.519908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e04541-e260-470b-9158-53225e777a44 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:26.523633 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:26.537116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 168/345] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:26.538509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e04541-e260-470b-9158-53225e777a44 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:26.562615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed5050-f59e-4e0d-9dbe-39ae9996d834 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.602288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:26.602898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.603216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.603486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.604289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:26.604592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:26.606255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:26.620008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 178/346] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:26.620619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:26.676791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e04541-e260-470b-9158-53225e777a44 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.729027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:26.729669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.729949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.730223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.743071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:26.744568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:26.757585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3efc8-1baa-435a-8c4e-43d310e87bea None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:26.761027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:26.761909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:26.763211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:26.763211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:26.763211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:26.766591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 169/347] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:26.767908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:26.779208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:26.794308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:26.801196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:26.801836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.802124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.802402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.803124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:26.804606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:26.828607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 179/348] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:26 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:26.829974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:26.899298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a7e1-651e-4a1b-95da-a9736e01fac2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.947530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644969c6-a0e8-4c44-936b-a9127cd0f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:26.948318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644969c6-a0e8-4c44-936b-a9127cd0f541 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.948608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644969c6-a0e8-4c44-936b-a9127cd0f541 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.948890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644969c6-a0e8-4c44-936b-a9127cd0f541 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.949634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644969c6-a0e8-4c44-936b-a9127cd0f541 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:26.951174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644969c6-a0e8-4c44-936b-a9127cd0f541 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:26.964115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412b8f-5d87-469f-9827-38ab61ef35b0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:26.983201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 170/349] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:26 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:26.983201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dfac7-6825-4304-8f2b-9b446b2cf430 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.983201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dfac7-6825-4304-8f2b-9b446b2cf430 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.983201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dfac7-6825-4304-8f2b-9b446b2cf430 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.983201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 171/350] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:26.983201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded9c73-e87a-403f-8498-90d51a024770 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.983201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded9c73-e87a-403f-8498-90d51a024770 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.983822 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded9c73-e87a-403f-8498-90d51a024770 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:26.984850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 172/351] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:26.986573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58173a2a-bba3-45f1-81ae-c8b3c5037292 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:26.986789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58173a2a-bba3-45f1-81ae-c8b3c5037292 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:26.987045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58173a2a-bba3-45f1-81ae-c8b3c5037292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.009948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-58173a2a-bba3-45f1-81ae-c8b3c5037292 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:27.012467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-58173a2a-bba3-45f1-81ae-c8b3c5037292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:27.040923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ba864-36fc-4144-a9c9-232f8285d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:27.041482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ba864-36fc-4144-a9c9-232f8285d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:27.041772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ba864-36fc-4144-a9c9-232f8285d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:27.042049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ba864-36fc-4144-a9c9-232f8285d2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.042728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ba864-36fc-4144-a9c9-232f8285d2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:27.043041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ba864-36fc-4144-a9c9-232f8285d2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:27.045327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ba864-36fc-4144-a9c9-232f8285d2b4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:27.062104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 180/352] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:27.064791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e48a-1314-405c-8f83-8d4343d0e800 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:27.065339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e48a-1314-405c-8f83-8d4343d0e800 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:27.065838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e48a-1314-405c-8f83-8d4343d0e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.091658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9ad0e48a-1314-405c-8f83-8d4343d0e800 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:27.093227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9ad0e48a-1314-405c-8f83-8d4343d0e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:27.096888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:27.107355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 173/353] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:27.108233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58173a2a-bba3-45f1-81ae-c8b3c5037292 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:27.183494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:27.186835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 181/354] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:27.231834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58173a2a-bba3-45f1-81ae-c8b3c5037292 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:27.268489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:27.269109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:27.269393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:27.269672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.270332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:27.271815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:27.299120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 174/355] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:27 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:27.427114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e48a-1314-405c-8f83-8d4343d0e800 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:27.534528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:27.552235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e48a-1314-405c-8f83-8d4343d0e800 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:27.596184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:27.596371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:27.597002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:27.597294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:27.597549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.598243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:27.599662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:27.610226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.sql.core [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 13:11:27.610226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 13:11:27.610226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [parameters: {'id': '6cc40d910d3b442386d2371f1cf2cfd5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 13:11:27.610226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 19 13:11:27.618097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return ref.to_dict() Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:11:27.618962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application yield resource Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise self.value Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application session.commit() Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 13:11:27.619887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.flush() Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application compat.raise_( Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 13:11:27.620723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:11:27.621575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:11:27.622365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [parameters: {'id': '6cc40d910d3b442386d2371f1cf2cfd5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:27.623190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 19 13:11:27.624017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:27.624865 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 182/356] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Oct 19 13:11:27 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:27.635170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:27.654830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950284-06df-4bd8-b511-c9ae9d2bd289 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:27.681886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:27.693290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:27.694614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:27.694614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:27.694614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.707458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:27.708941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:27.724732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:27.726660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:27.728665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:27.728665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:27.728665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:27.728665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 175/357] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:27.732807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:27.759105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50bf4-9b43-4005-82e2-2bac9c49525b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:27.819988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:27.820788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:27.821062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:27.821332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.839671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:27.851173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:27.852085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:27.852882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 183/358] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:11:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:27.859507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babf5fd-dbf7-42b3-858c-97f6e89778c5 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:27.859779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:27.861776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:27.900376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:27.901338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:27.901624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:27.901902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:27.902561 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:27.902883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:27.904508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:27.917083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 176/359] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:27.924611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:28.042500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70e3ad-12cc-4478-8cdd-540918a170b9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:28.044460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:28.079563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f8d6f-3f6e-4883-8e0c-2f117475c7d2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:28.095929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2853e2-48df-4af6-9dcd-91808e18f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:28.097862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2853e2-48df-4af6-9dcd-91808e18f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:28.098366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2853e2-48df-4af6-9dcd-91808e18f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:28.099437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2853e2-48df-4af6-9dcd-91808e18f9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:28.100423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2853e2-48df-4af6-9dcd-91808e18f9d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:28.101135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2853e2-48df-4af6-9dcd-91808e18f9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:28.104144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2853e2-48df-4af6-9dcd-91808e18f9d3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:28.122067 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 184/360] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:28.142529 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4e39f-d0fc-4b88-b7c8-75c34612b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:28.143569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4e39f-d0fc-4b88-b7c8-75c34612b10d None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:28.144117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4e39f-d0fc-4b88-b7c8-75c34612b10d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:28.144599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4e39f-d0fc-4b88-b7c8-75c34612b10d None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:28.145508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4e39f-d0fc-4b88-b7c8-75c34612b10d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:28.147282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4e39f-d0fc-4b88-b7c8-75c34612b10d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:28.179211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 177/361] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:27 2022] POST /identity/v3/users => generated 249 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:29.602980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43e052-9e7d-4145-ba89-ff31c0b102ce None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:29.604044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43e052-9e7d-4145-ba89-ff31c0b102ce None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:29.604537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43e052-9e7d-4145-ba89-ff31c0b102ce None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:29.606376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 185/362] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:29.611425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f51fa-2370-4a61-b982-e13024d3fa0f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:29.612228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f51fa-2370-4a61-b982-e13024d3fa0f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:29.612718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f51fa-2370-4a61-b982-e13024d3fa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:29.640065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bb6f51fa-2370-4a61-b982-e13024d3fa0f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:29.641639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bb6f51fa-2370-4a61-b982-e13024d3fa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:29.656574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:29.723813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 178/363] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:29.826315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb856d-d5ac-41ea-abc4-e3a4ac576a49 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:29.826657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb856d-d5ac-41ea-abc4-e3a4ac576a49 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:29.826869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb856d-d5ac-41ea-abc4-e3a4ac576a49 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:29.828520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 186/364] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:29.834306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43dd1-f41e-43fd-b2d7-a777ed5f9c4b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:29.834837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43dd1-f41e-43fd-b2d7-a777ed5f9c4b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:29.835418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43dd1-f41e-43fd-b2d7-a777ed5f9c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:29.862906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-43b43dd1-f41e-43fd-b2d7-a777ed5f9c4b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:29.864468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-43b43dd1-f41e-43fd-b2d7-a777ed5f9c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:29.952388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 179/365] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:30.054267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb856d-d5ac-41ea-abc4-e3a4ac576a49 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.145245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c41d4-9bf3-4042-a2c5-e47d94e4ea11 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.145866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c41d4-9bf3-4042-a2c5-e47d94e4ea11 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.146358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c41d4-9bf3-4042-a2c5-e47d94e4ea11 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.148057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 180/366] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:30.153059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cd17-2730-4102-ad17-019895efe7ec None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.153625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cd17-2730-4102-ad17-019895efe7ec None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.154263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181cd17-2730-4102-ad17-019895efe7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.186788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb856d-d5ac-41ea-abc4-e3a4ac576a49 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:30.187595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6181cd17-2730-4102-ad17-019895efe7ec None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:30.189096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6181cd17-2730-4102-ad17-019895efe7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:30.241662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:30.242296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.242569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.242839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.254336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:30.259663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:30.260821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:30.261886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:30.264711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 187/367] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:30.271056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.321342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:30.325821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 181/368] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:30.325821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181cd17-2730-4102-ad17-019895efe7ec None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.340885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:30.462145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145267-2127-4907-a0d4-0932c53c14da None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:30.491893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181cd17-2730-4102-ad17-019895efe7ec None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:30.530281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:30.530936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.531260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.531861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.536645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:30.537254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.537536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.537805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.538468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:30.538766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:30.540174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:30.543604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:30.549723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:30.550828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:30.551868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:30.557882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 182/369] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:30.559384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.565534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 188/370] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:30.576064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.675759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:30.715514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:30.721341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aea06-d8e8-4252-9259-26d36fd6e400 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:30.732598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08ecf-ee51-46c5-b0aa-f705fde18618 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:30.760592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:30.761711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.762262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.762742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.763673 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:30.764249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:30.765946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:30.770096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:30.770731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.771068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.771371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.781245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 183/371] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:30.782530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.782661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:30.784330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:30.801631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:30.802792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:30.804212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:30.804212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:30.804212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:30.804212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 189/372] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:30.804212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.893694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c8024-ab6b-4a21-b64a-b55d20a9502c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:30.921724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a75e-9e91-4331-b0f7-2183772d871f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:30.925358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:30.931196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b06b86-de0d-4020-845f-9049d28f8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:30.931831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06b86-de0d-4020-845f-9049d28f8e5d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.932111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06b86-de0d-4020-845f-9049d28f8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.932449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06b86-de0d-4020-845f-9049d28f8e5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.944170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b06b86-de0d-4020-845f-9049d28f8e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-08b06b86-de0d-4020-845f-9049d28f8e5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:30.949416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:30.950392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 184/373] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:30.951815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715eee5-446d-4075-8615-b8d7531d41b4 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.952773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715eee5-446d-4075-8615-b8d7531d41b4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.952773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715eee5-446d-4075-8615-b8d7531d41b4 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.953436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 185/374] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:30.954129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715eee5-446d-4075-8615-b8d7531d41b4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:30.963177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6927-879c-43f3-8f46-21a1085c1990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:30.963808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6927-879c-43f3-8f46-21a1085c1990 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.964090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6927-879c-43f3-8f46-21a1085c1990 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.964359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6927-879c-43f3-8f46-21a1085c1990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.971388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:30.976378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6927-879c-43f3-8f46-21a1085c1990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:30.977820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6927-879c-43f3-8f46-21a1085c1990 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-291f6927-879c-43f3-8f46-21a1085c1990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:30.992213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:30.993105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:30.993958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:30.993958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:30.993958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:30.993958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 190/375] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:30.994647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70574-c496-4a95-aae2-808c6293f854 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.994762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70574-c496-4a95-aae2-808c6293f854 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.994936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70574-c496-4a95-aae2-808c6293f854 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:30.999468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 191/376] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:30.999468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941364-d2cc-4980-be69-6654c6cd0dff None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:30.999468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941364-d2cc-4980-be69-6654c6cd0dff None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:30.999468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941364-d2cc-4980-be69-6654c6cd0dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.015624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bc941364-d2cc-4980-be69-6654c6cd0dff None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:31.016815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bc941364-d2cc-4980-be69-6654c6cd0dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:31.060429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715eee5-446d-4075-8615-b8d7531d41b4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.081710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 192/377] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:31.082542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc941364-d2cc-4980-be69-6654c6cd0dff None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.116255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.117247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.117725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.118202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.119051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:31.119548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.121078 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.133185 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 186/378] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:31.134209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.184490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc941364-d2cc-4980-be69-6654c6cd0dff None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.201700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.206916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.221998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296795e-f551-4ae5-96ef-0ed244e7d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.222782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296795e-f551-4ae5-96ef-0ed244e7d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.223071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296795e-f551-4ae5-96ef-0ed244e7d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.223413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296795e-f551-4ae5-96ef-0ed244e7d1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.224083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296795e-f551-4ae5-96ef-0ed244e7d1b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:31.224389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296795e-f551-4ae5-96ef-0ed244e7d1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.225770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296795e-f551-4ae5-96ef-0ed244e7d1b7 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.233524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 193/379] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:31.234668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c456e-1b70-4bf9-9f7d-176cbc69c3f9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.234948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c456e-1b70-4bf9-9f7d-176cbc69c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.235254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c456e-1b70-4bf9-9f7d-176cbc69c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.254032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-388c456e-1b70-4bf9-9f7d-176cbc69c3f9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:31.255555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-388c456e-1b70-4bf9-9f7d-176cbc69c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:31.264084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3635142-2d32-4760-bd20-73c174509bf6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.299536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.300142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.300415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.300690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.301320 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:31.301623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.302988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.319502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 187/380] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:31.319502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.334730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 194/381] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:31.335587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c456e-1b70-4bf9-9f7d-176cbc69c3f9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.431783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79889f3-22dc-443d-ba60-1c05e513deda None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.438008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c456e-1b70-4bf9-9f7d-176cbc69c3f9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.443129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.451367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.471125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.471761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.472101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.472325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.473101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.473724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.474021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.474268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.479926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.481692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.484211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.486431 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:31.496502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:31.497621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:31.498896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 188/382] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:31.502798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:31.504859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:31.505973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:31.507031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:31.507031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:31.507031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:31.508452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 195/383] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:31.509425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.609225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75083a6d-db84-4def-a60f-19ef3c89d4e7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.614133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274a534-6651-4288-ae1a-cb06710c3376 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.641856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.643047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.643358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.643634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.647238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.647856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.648133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.648403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.651042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.652556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.658525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:31.663858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:31.664746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:31.665539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:31.666755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:31.667621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 13:11:31.668593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:31.669107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 196/384] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:31.669107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.669897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 189/385] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:31.670545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.693279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.700486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.766553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983341-0671-47ff-9e20-844b89cfcff5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.767585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62c8a0-7708-4ea9-8b3f-2e6b1ad56cd2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.799071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.799657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.799788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.799950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.800222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.800317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.800630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.800860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:31.800951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.801163 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.801627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:31.801937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.802541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.803382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.814807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 190/386] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:31.819965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.840358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 197/387] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:31.841185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.911475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.921177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ad0f-7e69-4060-8246-8af8f8977d5b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.922616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:31.941317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00365a-887e-4418-bbbe-6f7e7c7778d0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:31.953999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.955194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.955470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.955738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.965308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.966748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.974082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:31.974694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:31.974974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:31.975274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:31.976006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:31.976316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:31.977749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:31.981022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:31.982071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:31.982941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:31.982941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:31.982941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:31.982941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 191/388] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:31.983205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:31.999727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 198/389] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:31.999727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.078669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e4a1-2358-43dd-a9be-5770a41a3735 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.096834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8f862-db4f-44a5-875a-94255828d005 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.113205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.113813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.114084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.114353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.115013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:32.115413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.116786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.124577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 192/390] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:32.125354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.132470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.132618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.133095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.133367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.133634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.140818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.142827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.145596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:32.157467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:32.158753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 199/391] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:32.159873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.235731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bcc58-c8f8-4c54-acc8-0f1bcfe4448c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.259238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100731e4-adcb-462e-a4dd-6eb0945ea6f3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.268454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.269099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.269375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.269653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.279817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.281251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.292702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.293306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.293587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.293858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.294490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:32.294792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:32.294882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:32.295930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:32.297190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:32.297190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:32.297190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:32.297190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 193/392] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:32.297190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.299460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.311190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 200/393] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:32.311991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.353557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.371545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.398040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752855-3a7e-4370-882c-0fcf7b44e4b8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.410786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1bb7f-a51b-4222-9602-b5fae4c2c9ed None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.431274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.431972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.432247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.432516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.443585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.445045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.445859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.446475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.446752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.447019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.456539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.457966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:32.458676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:32.459759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:32.460835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:32.460835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:32.460835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:32.460835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 194/394] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:32.460835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:32.475425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:32.476348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:32.481777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:32.481777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:32.481777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:32.481777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 201/395] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:32.481777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.562520 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61cf7-de10-4250-82d2-aaf8bb4382c6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.571992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.576496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002bc9f-2fca-45d3-8dbe-729844d3ec4d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.588756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.597712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.598317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.598601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.598878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.599651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:32.599964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.601415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.609103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.609640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.609914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.610179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.612160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:32.612160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.612997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.624116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 202/396] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:32.624880 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.645996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 195/397] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:32.645996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.724798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90571cdc-9241-4cca-bcfd-7f9ab6ba62fa None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.739407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31d10-1e18-4f64-856b-25ada53d0856 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.759088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.759711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.759988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.760259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.760910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.762341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.771650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.772254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.772537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.772814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.773461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:32.774005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.775188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.783504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 203/398] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:32 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:32.784309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.787352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 196/399] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:32.788539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.823552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.827637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:32.907405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9be3b-4add-4aba-8d95-d7c6c5c6bad4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.916640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d9cf-258d-49c2-87f5-d5788ce5dd0a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:32.947481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.948239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.948579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.948859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.952941 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:32.953553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:32.953832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:32.954104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:32.954831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:32.955221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.955998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:32.956537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.957451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:32.969013 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 204/400] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:32.969849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:32.971290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:32.972159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:32.972584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:32.972660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 197/401] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:32.973267 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.062668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.076935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab490-0b9f-43b7-8a7a-27e08e18548d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.081369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.098831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ae34-e7cb-4cc4-af11-41724e656e1d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.112466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.113102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.113389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.113666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.123484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.124935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.135910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.136547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.136829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.137104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:33.140678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:33.141546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:33.147860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:33.147860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:33.147860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:33.147860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 205/402] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:33.147860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.148146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.148146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:33.158753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:33.159801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 198/403] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:33.166200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.260466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321872f-f25a-4d26-b241-20295a5b8d09 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.272475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60fc4-5120-4644-87c4-34dfceaf27d8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.298541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.299303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.299580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.299960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.307366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.308229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.308342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.308503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.308772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.309462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:33.309675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.309773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.311252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.312919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:33.323412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:33.324372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 206/404] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:33.330852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.331859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 199/405] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:33.331859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.340730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.437841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463fe35-5c23-487f-9f34-259fcfdb5b7e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.442120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a00c7d-b470-4d30-afac-7592b35e1241 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.474336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.475031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.475329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.475605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.476388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:33.476696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.476875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.477482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.477762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.478038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.478227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.478675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:33.478978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.480371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.490811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 200/406] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:33.491731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.493521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 207/407] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:33.494725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.558547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.563771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.596707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23653de4-6332-49b2-ba6b-92f2146e21ca None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.608488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fe51-a466-4cb3-8aeb-060082e3256c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.632924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.633528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.633804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.634071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.634795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:33.635109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.636556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.645149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.645810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.646095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.646371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1433a2c778346a09a10845139967c27/roles/4ca7ffa01f0e4e27906254cb664bc03f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.659108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 201/408] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:33.659108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.665158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=c1433a2c778346a09a10845139967c27, role_id=4ca7ffa01f0e4e27906254cb664bc03f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.666614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.680551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 208/409] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:33 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1433a2c778346a09a10845139967c27/roles/4ca7ffa01f0e4e27906254cb664bc03f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:33.688536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.776402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e834fe0-99a1-4169-a84d-aa3cc8c466b7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.805375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.820632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.821482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.821767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.822042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/997c5e419c4045f4b8db4f6c1865d18b/roles/4ca7ffa01f0e4e27906254cb664bc03f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.840954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=997c5e419c4045f4b8db4f6c1865d18b, role_id=4ca7ffa01f0e4e27906254cb664bc03f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.842653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.846960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d86502-e5d1-4440-9d25-2f24bd263b37 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:33.864004 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:33.864624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 202/410] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:33 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/997c5e419c4045f4b8db4f6c1865d18b/roles/4ca7ffa01f0e4e27906254cb664bc03f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:33.865521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:33.900126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:33.900902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:33.902088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:33.902451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:33.910924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:33.913292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:33.927732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:33.928676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:33.929991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 209/411] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:33.936084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:34.065173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425dede-f747-48de-b63b-14cd8d8de015 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:34.077636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b54e2b-99a0-43b7-adb5-4c2d8ebe73a8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:34.108145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:34.109314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:34.109759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:34.110318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:34.122983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:34.123638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:34.124093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:34.124472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:34.125159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:34.125277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:34.125474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:34.126999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:34.127257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:34.144568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:34.145735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:34.146819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:34.146819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:34.146819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:34.148371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 203/412] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:34.152134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 210/413] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:34.153914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:34.158490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:34.186744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:34.193778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:34.266021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618bbb1-922e-42bc-ae47-7ace5538b93a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:34.271826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f485c-993e-4a8f-8785-bf0ba57f7179 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:34.315921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:34.316944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:34.317425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:34.317895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/908ecd4f59ba49e7bec2a57700bdf957/roles/4ca7ffa01f0e4e27906254cb664bc03f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:34.338176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:34.339259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:34.339745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:34.340221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:34.341105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:34.341622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:34.343232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:34.346697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=908ecd4f59ba49e7bec2a57700bdf957, role_id=4ca7ffa01f0e4e27906254cb664bc03f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:34.348398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:34.363472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 204/414] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:34.370757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:34.372641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 211/415] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:34 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/908ecd4f59ba49e7bec2a57700bdf957/roles/4ca7ffa01f0e4e27906254cb664bc03f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:34.494533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:34.516664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aa0f6-e1f9-432f-b265-17108b4cb470 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:34.572055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:34.572642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:34.572927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:34.573207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:34.581907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:34.583474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:34.600081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:34.600989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:34.602311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 205/416] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:34.607347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:34.724786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:34.746555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdd11e-84e0-402e-87ab-b09e9a8f4989 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:34.786026 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ca32-5190-4d07-85aa-10b9f46ef038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:34.786712 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ca32-5190-4d07-85aa-10b9f46ef038 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:34.786996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ca32-5190-4d07-85aa-10b9f46ef038 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:34.787299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ca32-5190-4d07-85aa-10b9f46ef038 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:34.787998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82ca32-5190-4d07-85aa-10b9f46ef038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:34.788306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82ca32-5190-4d07-85aa-10b9f46ef038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:34.789821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82ca32-5190-4d07-85aa-10b9f46ef038 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:34.802172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 212/417] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:34.807845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:34.945184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6eb5-8e0a-4da8-9e90-6d452a5774a6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:34.987788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394022a-ae69-410d-98bf-22d0109bf627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:34.988459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394022a-ae69-410d-98bf-22d0109bf627 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:34.988740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394022a-ae69-410d-98bf-22d0109bf627 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:34.989019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394022a-ae69-410d-98bf-22d0109bf627 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/9b0ffc12a2fe49938b8a5ab56cd9721f/roles/4ca7ffa01f0e4e27906254cb664bc03f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:35.006819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394022a-ae69-410d-98bf-22d0109bf627 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=9b0ffc12a2fe49938b8a5ab56cd9721f, role_id=4ca7ffa01f0e4e27906254cb664bc03f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:35.008326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394022a-ae69-410d-98bf-22d0109bf627 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:35.016099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:35.040342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 206/418] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:34 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/9b0ffc12a2fe49938b8a5ab56cd9721f/roles/4ca7ffa01f0e4e27906254cb664bc03f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:35.176201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b0b1-ffd4-49c7-bfb6-3fdc4e256c64 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:35.176760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b0b1-ffd4-49c7-bfb6-3fdc4e256c64 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:35.176760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b0b1-ffd4-49c7-bfb6-3fdc4e256c64 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:35.178416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 213/419] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:35.185758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a4f7-c274-498a-a029-58c72197f2da None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:35.186047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a4f7-c274-498a-a029-58c72197f2da None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:35.186322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a4f7-c274-498a-a029-58c72197f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:35.206817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0c92a4f7-c274-498a-a029-58c72197f2da None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:35.208006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0c92a4f7-c274-498a-a029-58c72197f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:35.295315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 207/420] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:35.632436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b0b1-ffd4-49c7-bfb6-3fdc4e256c64 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:35.764720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b0b1-ffd4-49c7-bfb6-3fdc4e256c64 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:35.811029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:35.811697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:35.811973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:35.812249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:35.825530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:35.830504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:35.835685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:35.836601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:35.837842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 214/421] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:35.843126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92a4f7-c274-498a-a029-58c72197f2da None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:35.945703 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92a4f7-c274-498a-a029-58c72197f2da None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:35.972712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:35.981476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:35.982102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:35.982391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:35.982658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:35.983368 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:35.983736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:35.985117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:35.994425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 208/422] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:35.999996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:36.111513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304959-fdd9-40cd-a977-090fbda36f05 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:36.159165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1de980-7a7d-4e73-b556-2d2e6ef3aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:36.159834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1de980-7a7d-4e73-b556-2d2e6ef3aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.160116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1de980-7a7d-4e73-b556-2d2e6ef3aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.160386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1de980-7a7d-4e73-b556-2d2e6ef3aeb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.178133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1de980-7a7d-4e73-b556-2d2e6ef3aeb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:36.179648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1de980-7a7d-4e73-b556-2d2e6ef3aeb2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7d1de980-7a7d-4e73-b556-2d2e6ef3aeb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:36.203189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:36.204118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:36.206171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:36.206171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:36.206171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:36.206171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 215/423] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:36.210287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:36.280509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d639-1977-4c0a-8ef6-e6dd9abdfc33 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.280829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d639-1977-4c0a-8ef6-e6dd9abdfc33 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.281383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d639-1977-4c0a-8ef6-e6dd9abdfc33 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.283245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 216/424] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:36.291842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7469-9ab3-4f53-a604-76cafea62994 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.292127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7469-9ab3-4f53-a604-76cafea62994 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.292885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7469-9ab3-4f53-a604-76cafea62994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.318527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3d3e7469-9ab3-4f53-a604-76cafea62994 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:36.319770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3d3e7469-9ab3-4f53-a604-76cafea62994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:36.319986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593ef13-6ef0-42cb-85e2-e6cf80d36e16 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:36.388823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:36.389432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.389712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.389986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.390644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:36.394702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:36.396145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:36.411822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:36.422780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 209/425] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:36.429942 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:36.454170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 217/426] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:36.520767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:36.591030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5534760-6618-4269-a8f7-d87f8dd6d553 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:36.643891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1d257-a916-4652-897f-82a3e5d5037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:36.644547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1d257-a916-4652-897f-82a3e5d5037e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.644824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1d257-a916-4652-897f-82a3e5d5037e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.645091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1d257-a916-4652-897f-82a3e5d5037e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.653103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1d257-a916-4652-897f-82a3e5d5037e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:36.654581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1d257-a916-4652-897f-82a3e5d5037e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-a8c1d257-a916-4652-897f-82a3e5d5037e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:36.671514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:36.672474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:36.674034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 210/427] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:36.678522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e7469-9ab3-4f53-a604-76cafea62994 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:36.744632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03523b-187c-4969-be6f-27d5a2fee19a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.745203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03523b-187c-4969-be6f-27d5a2fee19a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.745662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03523b-187c-4969-be6f-27d5a2fee19a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.747223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 211/428] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:36.764306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641949e1-aa0c-4ccd-b717-731206126abf None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.764813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641949e1-aa0c-4ccd-b717-731206126abf None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.765287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641949e1-aa0c-4ccd-b717-731206126abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.788194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-641949e1-aa0c-4ccd-b717-731206126abf None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:36.789503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-641949e1-aa0c-4ccd-b717-731206126abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:36.828244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e7469-9ab3-4f53-a604-76cafea62994 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:36.864628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:36.865298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:36.865644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:36.865985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:36.866890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:36.867287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:36.868815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:36.886353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 212/429] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:36.887963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641949e1-aa0c-4ccd-b717-731206126abf None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:36.893443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 218/430] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Oct 19 13:11:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:36.894527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:36.940051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:36.942710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:37.011755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641949e1-aa0c-4ccd-b717-731206126abf None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.030399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c401b-bc54-484c-a65c-98865fd3b26c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.050165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.050799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.051057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.051352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.061750 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:37.067621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:37.068538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:37.069973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 213/431] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:37.074314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.087529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368049e-0535-4227-88c9-fe13500e8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.088533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368049e-0535-4227-88c9-fe13500e8f12 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.089018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368049e-0535-4227-88c9-fe13500e8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.089612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368049e-0535-4227-88c9-fe13500e8f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.120331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368049e-0535-4227-88c9-fe13500e8f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:37.122166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368049e-0535-4227-88c9-fe13500e8f12 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-8368049e-0535-4227-88c9-fe13500e8f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:37.138132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:37.139364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:37.140701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:37.140701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:37.140701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:37.140701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 219/432] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:37.140701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652668b-859b-43e3-a1b4-578a3ae61bf6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.140701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652668b-859b-43e3-a1b4-578a3ae61bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.141020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652668b-859b-43e3-a1b4-578a3ae61bf6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.146358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 220/433] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:37.147192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652668b-859b-43e3-a1b4-578a3ae61bf6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.206592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:37.212410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca68168-180c-4ff6-b8e7-3694e16cd570 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.252556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:37.260136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438de6e-b798-40ef-881b-59876d97ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.261570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438de6e-b798-40ef-881b-59876d97ef94 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.262116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438de6e-b798-40ef-881b-59876d97ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.262616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438de6e-b798-40ef-881b-59876d97ef94 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.263518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438de6e-b798-40ef-881b-59876d97ef94 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:37.264110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438de6e-b798-40ef-881b-59876d97ef94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:37.264215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652668b-859b-43e3-a1b4-578a3ae61bf6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.266323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438de6e-b798-40ef-881b-59876d97ef94 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:37.275932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 214/434] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:37.280793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2f7c-fcd6-4177-9573-d41433908c2f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.281084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2f7c-fcd6-4177-9573-d41433908c2f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.281637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d2f7c-fcd6-4177-9573-d41433908c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.301221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e84d2f7c-fcd6-4177-9573-d41433908c2f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:37.301595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.302209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.302420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e84d2f7c-fcd6-4177-9573-d41433908c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:37.302538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.302754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.303429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:37.303736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:37.305122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:37.317360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 221/435] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:37.317360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.375826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 215/436] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:37.377051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2f7c-fcd6-4177-9573-d41433908c2f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.440385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71d80-10a7-4cf9-a3db-f8a06d9e688c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.484959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.486999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.487517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.488251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.489623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:37.501752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d2f7c-fcd6-4177-9573-d41433908c2f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.503956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:37.509701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:37.510857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:37.511870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:37.519429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 222/437] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:37.519429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.539993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:37.550382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.551026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.551353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.551628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.565257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:37.567225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:37.586577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:37.587786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:37.588634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:37.588634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:37.588634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:37.588634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 216/438] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:37.588634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.650726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21401f2-9a0e-40c0-bb4a-51d4fe195635 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.687734 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.688756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.689512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.689975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.697997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:37.699949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:37.700408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5332d-c6e6-4240-bdd5-ec62b22f211f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:37.712078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:37.712937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:37.713785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:37.715861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 223/439] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:37.721356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.743421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.744035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.744317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.744597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.745265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:37.745661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:37.747141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:37.760564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 217/440] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:37.761528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.766236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:37.796960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:37.832570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641a3f2-d8a8-445b-9969-f67c8fb0fad3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.867898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efe526-95e0-4080-b52d-f5e34092890f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:37.868102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.868681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.869063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.869352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.870661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:37.870661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:37.871692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:37.883251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 224/441] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:37.884269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.909254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:37.909950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:37.910231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:37.910971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:37.921928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:37.927225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:37.928126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:37.928917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:37.933937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 218/442] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:37.934578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:37.996234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3c722-87fc-4bbb-a5da-67fac7b1bd66 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.000151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.032300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.038874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.039646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.039908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.040180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.040873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:38.041181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.042625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.043281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a3c62-f445-4045-aad3-191f5b3c82b6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.059578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 225/443] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:38.059578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.085388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.086028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.086313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.086590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.097429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.098916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:38.113633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:38.114754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:38.116229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:38.116229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:38.116229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:38.116229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 219/444] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:38.116229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.161718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cab3f-f0b0-48a1-8e3e-6301f7a8c8f9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.196923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.197552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.197832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.198105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.205747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.207278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.215529 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47b7a-9e4f-443f-9690-1eca05e5a77f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:38.218736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:38.219875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 226/445] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:38.220803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.232083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.249634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fa98a-79db-430f-be78-c54d48b4f621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.250249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa98a-79db-430f-be78-c54d48b4f621 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.250533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa98a-79db-430f-be78-c54d48b4f621 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.250809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa98a-79db-430f-be78-c54d48b4f621 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.252048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fa98a-79db-430f-be78-c54d48b4f621 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:38.252356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fa98a-79db-430f-be78-c54d48b4f621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.253738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fa98a-79db-430f-be78-c54d48b4f621 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.261448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 220/446] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:38.262688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fe470-7ce1-4538-ad8a-218e191c2e5f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.262981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fe470-7ce1-4538-ad8a-218e191c2e5f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.263292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fe470-7ce1-4538-ad8a-218e191c2e5f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.264505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 221/447] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:38.265209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fe470-7ce1-4538-ad8a-218e191c2e5f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.276508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.324124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf90970-fabd-44f8-954d-0d79ccf3b4a4 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.357339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.357995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.358279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.358550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/2d5405a020ae4d61810ae01872cf325b/roles/4ca7ffa01f0e4e27906254cb664bc03f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.365679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fe470-7ce1-4538-ad8a-218e191c2e5f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.373272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=2d5405a020ae4d61810ae01872cf325b, role_id=4ca7ffa01f0e4e27906254cb664bc03f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.374730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.387278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 227/448] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:38 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/2d5405a020ae4d61810ae01872cf325b/roles/4ca7ffa01f0e4e27906254cb664bc03f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:38.388072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.399421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.400054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.400329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.400595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.401255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:38.401573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.402992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.416545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 222/449] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:38.420427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.471629 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.517317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a378455-c9e8-4df8-b83d-967c3cde2a14 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.519157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.542174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b201ec-a7af-46c9-bf34-2db65d5b960d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.562320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658a92e-feef-4ff0-af1c-0fb1b1193329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.563057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a92e-feef-4ff0-af1c-0fb1b1193329 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.563432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a92e-feef-4ff0-af1c-0fb1b1193329 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.563777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a92e-feef-4ff0-af1c-0fb1b1193329 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.565431 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658a92e-feef-4ff0-af1c-0fb1b1193329 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:38.565743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658a92e-feef-4ff0-af1c-0fb1b1193329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.567199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658a92e-feef-4ff0-af1c-0fb1b1193329 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.585257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 228/450] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:38.586646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b2e2-cb6b-4889-84b4-6033b821a1c3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.586940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b2e2-cb6b-4889-84b4-6033b821a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.587332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b2e2-cb6b-4889-84b4-6033b821a1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.591939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.592576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.592855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.593128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.603857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.605325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.605428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c3a0b2e2-cb6b-4889-84b4-6033b821a1c3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:38.606523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c3a0b2e2-cb6b-4889-84b4-6033b821a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:38.621027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:38.621959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:38.622830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:38.622830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:38.622830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:38.622830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 223/451] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:38.623048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.687578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 229/452] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:38.687578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b2e2-cb6b-4889-84b4-6033b821a1c3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.732866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.745181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad341-1a69-48ee-9606-c1541c03451b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.789140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.789780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.790061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.790341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.793642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:38.803166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.804637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.805209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b2e2-cb6b-4889-84b4-6033b821a1c3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:38.819699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:38.820985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 19 13:11:38.822213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:38.825597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 224/453] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:38.826437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:38.855246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.855873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.856157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.856428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.929311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.930789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.943029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215a6f-0ad5-4ac6-8d53-26ea2863e0ac None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:38.980501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:38.981116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:38.981409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:38.981682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:38.982345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:38.982635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:38.984161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:38.996168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 225/454] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:38.999360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.012336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.026901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.038489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 230/455] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:39.039422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.109676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b420-7ee9-4bda-8967-7d8b4a16608e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.142888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146855f7-4cea-4f65-b171-a8ed45b454a0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.147802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.148410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.148688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.148964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.149697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:39.150003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.151477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.172599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 226/456] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Oct 19 13:11:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:39.174669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.185766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.186400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.186675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.186944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.199871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:39.204906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:39.205803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:39.206622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 231/457] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:39.208354 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.259993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.265971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.294219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef426c-0dd7-4189-9ebe-5833ff1f4839 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.325072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f940-f83f-4d1b-915f-d42cef4eaded None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.329872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.330507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.330789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.331122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.339456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.341088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:39.352443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:39.353309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:39.354207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 227/458] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:39.354767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.365738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.366309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.366593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.366867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.377699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.379225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:39.393727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:39.394595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:39.400195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:39.400195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:39.400195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:39.400195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 232/459] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:39.400195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.461151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d67acf-efba-41c3-b3cd-e273b6a7ba6e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.489466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.498103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.498712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.498994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.499297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.507833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb326fe5-d20a-4bb6-88f7-9cbb93a35b88 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.509335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.543029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.543662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.543945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.544218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.544881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:39.545183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.546556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.555176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 233/460] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:39.555969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.577562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.579026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.663219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c91f-2db1-4a86-b7ab-961ee0ee04b5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.687721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 228/461] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:39.688388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.697628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.698271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.698554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.698827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.699666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:39.699976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.701422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.716505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.718395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 234/462] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:39.720014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.746333 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.798883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08734385-ef23-4320-bcb6-29efbb215283 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.830483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3c7e-33b5-4e1f-8dc9-670f4be7849a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.836130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.836736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.837020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.837296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.837943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:39.838254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.839668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.851491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 229/463] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:39.852454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.867333 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:39.868577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:39.869046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:39.869487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:39.880877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:39.882502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:39.898019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:39.898963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:39.899960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:39.899960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:39.899960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:39.901436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 235/464] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:39.902326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:39.950526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:39.965318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67b8d-8abd-44d1-8d9d-16a9b41e7592 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:39.978077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.003004 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.003900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.004323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.004735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.005263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ca72-e2d4-46e3-8dcf-04b6f18c0554 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.017640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.019112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:40.033856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:40.034769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:40.035656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:40.035656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:40.035656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:40.035656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 230/465] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:40.039918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.042802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.043448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.043725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.043998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.113365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.114843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.147413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2973f6-c584-4434-9484-a3a01d8bed73 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.192196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.192913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.193191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.193461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.197412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.201372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.203035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.206217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:40.215898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:40.216776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:40.217655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 231/466] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:40.218746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.235249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 236/467] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:40.235249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.330618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61286bee-af45-49d8-879d-330c4d1072d3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.337099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb45c1-194d-4fba-9f7e-0794fba7ad10 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.365404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.366006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.366283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.366554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.367281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:40.367585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.368957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.372544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.373154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.373436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.373709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.374347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:40.374650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.376058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.382103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 232/468] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:40.383286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.391677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 237/469] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:40.393424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.431308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.455973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.499408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022ba2f-fc0e-43ff-a425-ff4091343a0d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.499748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea5c5f-ac95-4ea8-b764-a2aec788ce70 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.535918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.536124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.536530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.536700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.536812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.536975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.537063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.537243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.537764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:40.538074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.539551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.547395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.548870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.550974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 233/470] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:40.552016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:40.562414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:40.563581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:40.565206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:40.565206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:40.565206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:40.565206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 238/471] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:40.565206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.647286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.655029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33c22-3ee6-42d3-99bc-6fc62bda84e6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.663564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279095b-d8f9-4907-81f0-ae2eefa0660c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.675426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.689934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf639ba-71be-4c18-b77f-1d7fdddbbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.690626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf639ba-71be-4c18-b77f-1d7fdddbbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.690899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf639ba-71be-4c18-b77f-1d7fdddbbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.691200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf639ba-71be-4c18-b77f-1d7fdddbbcb5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.696691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.697310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.697593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.697861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.698400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf639ba-71be-4c18-b77f-1d7fdddbbcb5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.699889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf639ba-71be-4c18-b77f-1d7fdddbbcb5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.705753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.707260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-0cf639ba-71be-4c18-b77f-1d7fdddbbcb5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:40.711177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:40.712257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:40.713370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 234/472] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:40.713932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3597c-b9a2-4e5a-912b-4fbc82932186 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.713932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3597c-b9a2-4e5a-912b-4fbc82932186 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.714186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3597c-b9a2-4e5a-912b-4fbc82932186 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.719156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 235/473] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:40.719156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3597c-b9a2-4e5a-912b-4fbc82932186 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:40.719461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:40.720344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:40.721703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 239/474] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:40.722161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.817262 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3fe0-3b4c-426c-9cec-035b98458f2d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.817948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3597c-b9a2-4e5a-912b-4fbc82932186 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:40.850852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e373a9c-dd5d-4139-bb3c-ce1a3cbfc3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.851110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:40.851482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e373a9c-dd5d-4139-bb3c-ce1a3cbfc3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.851759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e373a9c-dd5d-4139-bb3c-ce1a3cbfc3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.851860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.852028 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e373a9c-dd5d-4139-bb3c-ce1a3cbfc3a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.852117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.852296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.852660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e373a9c-dd5d-4139-bb3c-ce1a3cbfc3a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:40.852958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e373a9c-dd5d-4139-bb3c-ce1a3cbfc3a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.853044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] RBAC: Adding query filter params (role.id=4ca7ffa01f0e4e27906254cb664bc03f, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=c1433a2c778346a09a10845139967c27) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:40.853306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:40.854355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e373a9c-dd5d-4139-bb3c-ce1a3cbfc3a5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.854733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:40.860314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 236/475] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/role_assignments?user.id=c1433a2c778346a09a10845139967c27&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=4ca7ffa01f0e4e27906254cb664bc03f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:40.861112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:40.877490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 240/476] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:40.877490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb0c7-792a-45ad-ad50-0822923ff05a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:40.877490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb0c7-792a-45ad-ad50-0822923ff05a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:40.877490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb0c7-792a-45ad-ad50-0822923ff05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:40.888590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.896654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-75efb0c7-792a-45ad-ad50-0822923ff05a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:40.897993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-75efb0c7-792a-45ad-ad50-0822923ff05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:40.931250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:40.977626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 241/477] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:40.979104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb0c7-792a-45ad-ad50-0822923ff05a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.002499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501cf0a-d002-4608-a7fc-c6a692c2be1e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.042038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.042372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.042651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.042924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.044145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:41.044456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.045949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.065256 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 237/478] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:41.066232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.125580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb0c7-792a-45ad-ad50-0822923ff05a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.182844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.183618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.183969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.184316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.185488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:41.185590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.187948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.192191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:41.196979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eda9ad-db77-489e-afa9-60205449cef5 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.198829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:41.210927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 242/479] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:41.210927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.241302 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.242794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.243385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.243899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.256402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.258593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:41.272803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:41.273697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:41.274535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 238/480] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:41.274990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.326416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57faa06-2256-4280-9b3a-a821250e2996 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.361873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.362499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.362905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.363007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.380606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a6262-d970-4533-a9d2-57719968e59e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.418104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.418708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.418983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.419282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.420013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] RBAC: Adding query filter params (role.id=4ca7ffa01f0e4e27906254cb664bc03f, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=997c5e419c4045f4b8db4f6c1865d18b) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:41.420322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.421838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.428302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:41.428871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 239/481] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/role_assignments?user.id=997c5e419c4045f4b8db4f6c1865d18b&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=4ca7ffa01f0e4e27906254cb664bc03f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:41.430117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.436223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.437912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.470486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:41.572093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 243/482] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:41.572845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c0921-766d-442e-9153-6cb4e9e332f0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.573082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.614067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.615871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.615871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.615871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.631624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:41.639390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:41.640304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:41.641208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:41.642386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 240/483] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:41.642588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.697473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:41.703527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e365-e2d6-47e1-bf51-3726f6396bd9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.744828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.746134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.746599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.747361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.748242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:41.748862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.749542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:41.750993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.766502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 244/484] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:41.768395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.770221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5dfba-c9c7-4fd3-ad72-782d6f145fbd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.816614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.817467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.817810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.818091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.831227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.833294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:41.852254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:41.853211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:41.854729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:41.854729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:41.854729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:41.854729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 241/485] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:41.854729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.897127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193ffd1-1fa6-4d23-8b85-def92a924154 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.942409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:41.943615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:41.944079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:41.944694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:41.946309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:41.946801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:41.948410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:41.958883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 245/486] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:41.960551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:41.983301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8b6d-649a-4b61-8ef3-6a2bb602c310 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:41.988774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:42.030701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.031527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.031903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.033363 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.034202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] RBAC: Adding query filter params (role.id=4ca7ffa01f0e4e27906254cb664bc03f, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=908ecd4f59ba49e7bec2a57700bdf957) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:42.034875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.036733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.046448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 242/487] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/role_assignments?user.id=908ecd4f59ba49e7bec2a57700bdf957&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=4ca7ffa01f0e4e27906254cb664bc03f => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:42.047537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:42.052468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:42.121689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e7b9-fdd0-4d23-9c6f-1aaf6cfb5413 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:42.205148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.205790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.206073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.206348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.207013 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:42.209056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.210500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.235435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 246/488] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:42.240443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:42.253678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff6be-f436-4fb2-96f4-a110968daa3f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:42.296422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.297065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.297348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.297625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.311057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.312570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:42.329390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:42.330858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:42.331709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:42.331709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:42.331709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:42.331709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 243/489] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:42.336816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:42.339231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:42.363873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5a19-6bfc-4ac5-81a5-db8f4cc3db18 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:42.397625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:42.402667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.403585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.404118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.404530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.412402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.414064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:42.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:42.426922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:42.427840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:42.429416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 247/490] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:42.435059 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:42.465426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c88a4a-6878-4bfe-9804-c78e0412eb01 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:42.540243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.541243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.543152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.543627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.544474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:42.545095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.549744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.575269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 244/491] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:42.581357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:42.629699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d22962-9448-4b6e-ada2-05d3b4e684d1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:42.668098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.669075 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.669547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.670010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.670890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:42.671489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.674718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.682945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:42.690425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 248/492] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:42.696863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:42.808386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04335e6-b7a6-4612-bdaf-625ecc790ef2 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:42.823008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90760e44-b93e-4d5a-9eff-2c5eaaedc11c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:42.851381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:42.863153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.863771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.864036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.864302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.865035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] RBAC: Adding query filter params (role.id=4ca7ffa01f0e4e27906254cb664bc03f, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=9b0ffc12a2fe49938b8a5ab56cd9721f) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:42.865338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.866779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.877973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 249/493] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:42 2022] GET /identity/v3/role_assignments?user.id=9b0ffc12a2fe49938b8a5ab56cd9721f&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=4ca7ffa01f0e4e27906254cb664bc03f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:42.885755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:42.886402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:42.886684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:42.887019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:42.894975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:42.896475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:42.909259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:42.910264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:42.911210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 245/494] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:42.920362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:43.029966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:43.091524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acbc8e-e43e-48cf-b8e2-509f1ff3d93d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:43.135868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf8c14-198d-4c1a-b46a-4a48873fc344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:43.136908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf8c14-198d-4c1a-b46a-4a48873fc344 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:43.137384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf8c14-198d-4c1a-b46a-4a48873fc344 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:43.137929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf8c14-198d-4c1a-b46a-4a48873fc344 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:43.138877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf8c14-198d-4c1a-b46a-4a48873fc344 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:43.139413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf8c14-198d-4c1a-b46a-4a48873fc344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:43.141099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf8c14-198d-4c1a-b46a-4a48873fc344 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:43.160590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 250/495] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Oct 19 13:11:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:43.168960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:43.196778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb60438-e05d-438a-ad00-7b057775d963 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:43.197070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb60438-e05d-438a-ad00-7b057775d963 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:43.197353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb60438-e05d-438a-ad00-7b057775d963 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:43.199485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 251/496] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:43.205732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6179d4-8e5d-4814-87ce-8d0fa6132efa None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:43.206086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6179d4-8e5d-4814-87ce-8d0fa6132efa None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:43.206287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6179d4-8e5d-4814-87ce-8d0fa6132efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:43.228771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9c6179d4-8e5d-4814-87ce-8d0fa6132efa None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:43.229971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9c6179d4-8e5d-4814-87ce-8d0fa6132efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:43.296274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4021-dd23-4ec9-90dc-d7c96bc09506 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:43.311459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 252/497] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:43.339921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:43.340616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:43.340961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:43.341309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:43.387500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:43.414614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:43.416256 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:43.530560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 246/498] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 19 13:11:43.536132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6179d4-8e5d-4814-87ce-8d0fa6132efa None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:43.594915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:43.659527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6179d4-8e5d-4814-87ce-8d0fa6132efa None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:43.666367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:43.717704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:43.718358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:43.718726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:43.719109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:43.731596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:43.733053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:43.754393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:43.755408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:43.756317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:43.756317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:43.756317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:43.756317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 253/499] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:43.763577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:43.795542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:43.832474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4024a-3743-41fd-82c9-5a561dbd0ede None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:43.895954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:43.896581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:43.896856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:43.897127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:43.909163 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:43.915831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:43.916743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:43.918092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 247/500] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:43.925559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:43.927170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ef524-6ef4-43b0-b873-6bc33203d606 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:43.941142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:44.031807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.032439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.033270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.033552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.034203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:44.034507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.035918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.043980 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210d13-f61e-484c-af14-a8c150e12dfb None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.068896 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 254/501] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:44.076061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.081127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1007598-8feb-4ae5-8452-679f34c8e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.081939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1007598-8feb-4ae5-8452-679f34c8e33a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.082218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1007598-8feb-4ae5-8452-679f34c8e33a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.082659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1007598-8feb-4ae5-8452-679f34c8e33a None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.083498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1007598-8feb-4ae5-8452-679f34c8e33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:44.083872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1007598-8feb-4ae5-8452-679f34c8e33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.085335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1007598-8feb-4ae5-8452-679f34c8e33a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.086880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:44.096327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 248/502] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:44.097822 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbac640-b3d0-4aec-92e5-bd8e6fda3b30 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.098178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbac640-b3d0-4aec-92e5-bd8e6fda3b30 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.098553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbac640-b3d0-4aec-92e5-bd8e6fda3b30 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.104223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 249/503] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:44.104223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbac640-b3d0-4aec-92e5-bd8e6fda3b30 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.211141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108060a-c8f2-43c7-9f41-a3b6b92f37a9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.242168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbac640-b3d0-4aec-92e5-bd8e6fda3b30 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.249484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a18a8-6a0f-4955-8d6e-dcea092853e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.250242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a18a8-6a0f-4955-8d6e-dcea092853e5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.250627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a18a8-6a0f-4955-8d6e-dcea092853e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.251002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a18a8-6a0f-4955-8d6e-dcea092853e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.258091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a18a8-6a0f-4955-8d6e-dcea092853e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.259681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a18a8-6a0f-4955-8d6e-dcea092853e5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-2f9a18a8-6a0f-4955-8d6e-dcea092853e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:44.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:44.272352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:44.273476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:44.274972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 255/504] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:44.276393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e87b12-3a5e-4a3e-b1dc-c83c9ec9ccbe None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.276700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e87b12-3a5e-4a3e-b1dc-c83c9ec9ccbe None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.277074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e87b12-3a5e-4a3e-b1dc-c83c9ec9ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.289713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.290521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.290902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.291312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.298158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b7e87b12-3a5e-4a3e-b1dc-c83c9ec9ccbe None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:44.303058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b7e87b12-3a5e-4a3e-b1dc-c83c9ec9ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:44.304754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.306430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:44.322713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:44.324003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:44.325143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:44.325143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:44.325143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:44.326475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:44.326817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 250/505] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:44.328167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.381639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:44.399259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 256/506] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:44.399259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e87b12-3a5e-4a3e-b1dc-c83c9ec9ccbe None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.469131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f957e-31e5-412a-a567-86b84e39ea19 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.506999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.507685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.507968 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.508244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.508942 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:44.509393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.510986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.526566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 251/507] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:44.534671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.571303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e87b12-3a5e-4a3e-b1dc-c83c9ec9ccbe None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.631496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.632502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.632989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.633564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.634540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:44.635071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.640907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.662084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 257/508] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:44.665466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595841b0-fe30-4319-8c18-e941c89bbb6e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.668454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.675660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:44.696104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:44.703620 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea69f09-c5c0-4d07-9728-4986c5bf236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.704316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69f09-c5c0-4d07-9728-4986c5bf236e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.704653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69f09-c5c0-4d07-9728-4986c5bf236e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.705444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69f09-c5c0-4d07-9728-4986c5bf236e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.706178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea69f09-c5c0-4d07-9728-4986c5bf236e None admin] RBAC: Adding query filter params (role.id=4ca7ffa01f0e4e27906254cb664bc03f, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=2d5405a020ae4d61810ae01872cf325b) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:44.706485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea69f09-c5c0-4d07-9728-4986c5bf236e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.707955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea69f09-c5c0-4d07-9728-4986c5bf236e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.714130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 252/509] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/role_assignments?user.id=2d5405a020ae4d61810ae01872cf325b&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=4ca7ffa01f0e4e27906254cb664bc03f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:44.715372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f0036-78fb-4781-9f4d-d7627d1a6555 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.715658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f0036-78fb-4781-9f4d-d7627d1a6555 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.715944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f0036-78fb-4781-9f4d-d7627d1a6555 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.717148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 253/510] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:44.728166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811e295-c83e-4db6-855c-812bc05cac0b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.728525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811e295-c83e-4db6-855c-812bc05cac0b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.728712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811e295-c83e-4db6-855c-812bc05cac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.760647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9811e295-c83e-4db6-855c-812bc05cac0b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:44.762250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9811e295-c83e-4db6-855c-812bc05cac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:44.849960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c675c-ebc6-4883-bea5-982bbb14bb35 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.860217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 254/511] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:44.862095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811e295-c83e-4db6-855c-812bc05cac0b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.890325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:44.890913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:44.891222 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:44.891504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:44.901006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:44.902461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:44.920779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:44.921723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:44.922647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 258/512] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:44.928733 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:44.990902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811e295-c83e-4db6-855c-812bc05cac0b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:44.992689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:45.017852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:45.030344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.030797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.031104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.031395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.041820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.043390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.056954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140f32-5c69-4aa5-9ac8-48a804e59b85 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:45.058169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:45.059351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:45.060501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:45.060501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:45.060501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:45.064465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 255/513] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:45.066986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.107870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.108877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.109379 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.109864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.111338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:45.111851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.113878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.135577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 259/514] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Oct 19 13:11:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:45.145601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.197990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e6edc-1c13-4311-b403-5a30bb126446 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.250749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.251645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.252158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.255100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.255100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:45.255100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.255542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.275172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 256/515] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:45.276110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.283735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54d8f7-b170-4772-bad9-4fb094522a83 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.299979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:45.320003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:45.327567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.328401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.328821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.329263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.341296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.343071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:45.362403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:45.363510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:45.364402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:45.364402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:45.364402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:45.366494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 260/516] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:45.367650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.407416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713ea18-aae9-40ff-be39-ee86b0e13dc4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.443962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.444898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.445384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.445825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.446583 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.448222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:45.461045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:45.462063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:45.462932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:45.467120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 257/517] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:45.468111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.503616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64dbc-a2cd-47f4-b0ad-a214114a5ad0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.544580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.545677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.546197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.546713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.547609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.549977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.559355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:45.575876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 261/518] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:11:45 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:45.577891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.602925 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8157f-19c0-4da2-965a-6825fae4ca3b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.648478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:45.662386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ee1ba-ff5b-44b8-b842-74cbb28a0119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.662927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ee1ba-ff5b-44b8-b842-74cbb28a0119 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.663235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ee1ba-ff5b-44b8-b842-74cbb28a0119 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.663511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ee1ba-ff5b-44b8-b842-74cbb28a0119 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.664470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ee1ba-ff5b-44b8-b842-74cbb28a0119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:45.664780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ee1ba-ff5b-44b8-b842-74cbb28a0119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.666710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ee1ba-ff5b-44b8-b842-74cbb28a0119 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.688891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 258/519] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:45.688891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226a5c-f973-4f2d-902e-0b518cd1959a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.688891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226a5c-f973-4f2d-902e-0b518cd1959a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.688891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226a5c-f973-4f2d-902e-0b518cd1959a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.693154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 259/520] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:45.694335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc226a5c-f973-4f2d-902e-0b518cd1959a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.731887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bd58f-a259-478a-a1a0-91eeabc22f80 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.770148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211327b-70da-4875-b172-1388436cb5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.771106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211327b-70da-4875-b172-1388436cb5ee None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.771640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211327b-70da-4875-b172-1388436cb5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.772225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211327b-70da-4875-b172-1388436cb5ee None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.773074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211327b-70da-4875-b172-1388436cb5ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:45.773562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211327b-70da-4875-b172-1388436cb5ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.775881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211327b-70da-4875-b172-1388436cb5ee None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.786416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 262/521] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:45.786416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80cac2-678c-4123-916a-ade38a3681ba None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.786416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80cac2-678c-4123-916a-ade38a3681ba None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.786416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80cac2-678c-4123-916a-ade38a3681ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.805539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bf80cac2-678c-4123-916a-ade38a3681ba None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:45.807029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bf80cac2-678c-4123-916a-ade38a3681ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:45.835167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc226a5c-f973-4f2d-902e-0b518cd1959a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:45.873086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:45.873723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:45.874008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:45.874281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:45.881376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:45.882829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:45.884574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:45.895105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 263/522] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:45.895355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:45.896216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:45.897115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 260/523] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:45.901769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.903721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80cac2-678c-4123-916a-ade38a3681ba None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:45.962771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:46.058377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688b05-d295-4d2c-ac1e-f4612c56985c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:46.082968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80cac2-678c-4123-916a-ade38a3681ba None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:46.120171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:46.120783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:46.121063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:46.121338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:46.121983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:46.122289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:46.123705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:46.139185 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 261/524] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:46.158523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58812443-9f64-491c-8b91-13f922948221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:46.159263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58812443-9f64-491c-8b91-13f922948221 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:46.159547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58812443-9f64-491c-8b91-13f922948221 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:46.159823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58812443-9f64-491c-8b91-13f922948221 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:46.160539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58812443-9f64-491c-8b91-13f922948221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:46.160848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58812443-9f64-491c-8b91-13f922948221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:46.162303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58812443-9f64-491c-8b91-13f922948221 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:46.185534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 264/525] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:46.192325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:46.195900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58812443-9f64-491c-8b91-13f922948221 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:46.299766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:46.307859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:46.318801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58812443-9f64-491c-8b91-13f922948221 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:46.360864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:46.361567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:46.361856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:46.362128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] PATH_INFO: `/v3/services/network` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:46.362837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:46.364364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:46.369649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d2436-3a69-4954-a263-7b0807e6aa8e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:46.376149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:46.377717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:46.378625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:46.381435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 265/526] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:46 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:46.384126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:46.411660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:46.412709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:46.413261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:46.413820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1433a2c778346a09a10845139967c27/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:46.416075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=c1433a2c778346a09a10845139967c27, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:46.417853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:46.433632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 262/527] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:46 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1433a2c778346a09a10845139967c27/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:46.500728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457e14f-9f75-4903-82f3-ec228e26df6d None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:46.540841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaee41-c852-4b94-8d17-81054d8aa355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:46.541469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaee41-c852-4b94-8d17-81054d8aa355 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:46.541750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaee41-c852-4b94-8d17-81054d8aa355 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:46.542025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaee41-c852-4b94-8d17-81054d8aa355 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:46.542672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaee41-c852-4b94-8d17-81054d8aa355 None admin] RBAC: Adding query filter params (name=network) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:46.542976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaee41-c852-4b94-8d17-81054d8aa355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:46.544406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaee41-c852-4b94-8d17-81054d8aa355 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:46.549558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 266/528] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:11:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:46.555704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:46.679018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e81f42-0e65-4167-a11b-41258a82a72c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:46.712409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:46.726778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f0ac7-5ac0-4513-ab9c-e8a8dbecb850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:46.727637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f0ac7-5ac0-4513-ab9c-e8a8dbecb850 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:46.727922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f0ac7-5ac0-4513-ab9c-e8a8dbecb850 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:46.728198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f0ac7-5ac0-4513-ab9c-e8a8dbecb850 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:46.728843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f0ac7-5ac0-4513-ab9c-e8a8dbecb850 None admin] RBAC: Adding query filter params (type=network) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:46.729156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f0ac7-5ac0-4513-ab9c-e8a8dbecb850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:46.730552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f0ac7-5ac0-4513-ab9c-e8a8dbecb850 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:46.740834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 263/529] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:11:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:47.205968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf794-4511-4e16-a846-280e31f65695 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:47.206482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf794-4511-4e16-a846-280e31f65695 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:47.206482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf794-4511-4e16-a846-280e31f65695 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:47.208124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 267/530] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:47.213761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f5bd-d8d2-4f67-ba02-812d7c91b455 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:47.214060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f5bd-d8d2-4f67-ba02-812d7c91b455 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:47.214343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f5bd-d8d2-4f67-ba02-812d7c91b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:47.244429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6a72f5bd-d8d2-4f67-ba02-812d7c91b455 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:47.245979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6a72f5bd-d8d2-4f67-ba02-812d7c91b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:47.324702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 264/531] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:47.729200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bf794-4511-4e16-a846-280e31f65695 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:47.758079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:47.841929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bf794-4511-4e16-a846-280e31f65695 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:47.884252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:47.884891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:47.885171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:47.885439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:47.899529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:47.904406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:47.905334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:47.906336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 268/532] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:47.911763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f5bd-d8d2-4f67-ba02-812d7c91b455 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:48.026564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f5bd-d8d2-4f67-ba02-812d7c91b455 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:48.043309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:48.065265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9b40-d268-462c-bfdc-62ebd1b05e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:48.065878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9b40-d268-462c-bfdc-62ebd1b05e01 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:48.066250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9b40-d268-462c-bfdc-62ebd1b05e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:48.066528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9b40-d268-462c-bfdc-62ebd1b05e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:48.067449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9b40-d268-462c-bfdc-62ebd1b05e01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:48.067754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9b40-d268-462c-bfdc-62ebd1b05e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:48.069199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9b40-d268-462c-bfdc-62ebd1b05e01 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:48.078207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 265/533] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:48.084111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:48.214304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:48.242869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a8bf8-2124-41c4-a7a0-3abe9f5c877f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:48.277763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094626aa-a031-47d7-a698-7ecd49461463 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:48.278162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094626aa-a031-47d7-a698-7ecd49461463 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:48.278563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094626aa-a031-47d7-a698-7ecd49461463 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:48.280044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 266/534] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:48.285050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bcaff-8836-4ee6-9529-14b9c8578754 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:48.285430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bcaff-8836-4ee6-9529-14b9c8578754 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:48.285798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bcaff-8836-4ee6-9529-14b9c8578754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:48.290626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:48.291293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:48.291583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:48.291853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:48.302858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:48.304463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:48.305175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9a8bcaff-8836-4ee6-9529-14b9c8578754 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:48.306373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9a8bcaff-8836-4ee6-9529-14b9c8578754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:48.319873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:48.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:48.321711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:48.321711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:48.321711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:48.321711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 269/535] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:48.332155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:48.382979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 267/536] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 19 13:11:48.492846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869bffc-02fb-4a04-9cf9-88510285bff6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:48.533746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:48.543981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:48.545097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:48.545773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:48.546368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:48.547412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:48.547725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:48.549651 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:48.568443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 270/537] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:48.573978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bcaff-8836-4ee6-9529-14b9c8578754 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:48.717282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:48.750688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bcaff-8836-4ee6-9529-14b9c8578754 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:48.765611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:48.809165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:48.810249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:48.811465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:48.811762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:48.828182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:48.830203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:48.849910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:48.850927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:48.851940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:48.852482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1474f5-5e13-4ffe-8163-47117d87a66e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:48.852556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 268/538] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:48.856902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:48.959838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:48.960496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:48.960773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:48.961037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:48.977490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:48.981169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870101b-6094-41ad-9247-1da218f1b410 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:48.986247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:48.987207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:48.988077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 271/539] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:48.994118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.039122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719633cf-eee7-4767-bb58-790828abd912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.039791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719633cf-eee7-4767-bb58-790828abd912 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.040074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719633cf-eee7-4767-bb58-790828abd912 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.040353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719633cf-eee7-4767-bb58-790828abd912 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.041095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719633cf-eee7-4767-bb58-790828abd912 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:49.041405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719633cf-eee7-4767-bb58-790828abd912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.042865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719633cf-eee7-4767-bb58-790828abd912 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.061040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 269/540] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Oct 19 13:11:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:49.062356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aff2c-1746-4d0e-a902-00da5a59aadb None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.062650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aff2c-1746-4d0e-a902-00da5a59aadb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.062927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aff2c-1746-4d0e-a902-00da5a59aadb None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.064178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.066235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 270/541] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:49.070984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aff2c-1746-4d0e-a902-00da5a59aadb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.101330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.119699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6a26f-b240-4611-833c-25bb847397f8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.157641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdbfd5-da61-4bcb-9c10-72b5da734197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.159193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdbfd5-da61-4bcb-9c10-72b5da734197 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.159616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdbfd5-da61-4bcb-9c10-72b5da734197 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.160027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdbfd5-da61-4bcb-9c10-72b5da734197 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.160826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdbfd5-da61-4bcb-9c10-72b5da734197 None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:49.161365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdbfd5-da61-4bcb-9c10-72b5da734197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.162995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdbfd5-da61-4bcb-9c10-72b5da734197 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.178421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 272/542] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:49.185969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086ec8-90ee-4f52-a60e-9cef6afbb225 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.186411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086ec8-90ee-4f52-a60e-9cef6afbb225 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.186856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086ec8-90ee-4f52-a60e-9cef6afbb225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.207421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aff2c-1746-4d0e-a902-00da5a59aadb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.208657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-eb086ec8-90ee-4f52-a60e-9cef6afbb225 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:49.210216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eb086ec8-90ee-4f52-a60e-9cef6afbb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:49.254219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.254877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.255191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.255471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.274120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.276757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.293761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 273/543] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:49.295350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086ec8-90ee-4f52-a60e-9cef6afbb225 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:49.302704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:49.303678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:49.304553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:49.304553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:49.304553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:49.310069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 271/544] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:49.316054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.379491 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.417254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.433713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086ec8-90ee-4f52-a60e-9cef6afbb225 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.443777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823040-07f1-47ba-b32a-86cfe2cd7e12 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.468862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b3b91-ba37-4c03-baba-c36fc7e3d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.469559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3b91-ba37-4c03-baba-c36fc7e3d509 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.469838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3b91-ba37-4c03-baba-c36fc7e3d509 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.470164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3b91-ba37-4c03-baba-c36fc7e3d509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.480569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b3b91-ba37-4c03-baba-c36fc7e3d509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.482115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b3b91-ba37-4c03-baba-c36fc7e3d509 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.482481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77ad21-8f11-4269-9ee8-b5493ed56d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.483362 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77ad21-8f11-4269-9ee8-b5493ed56d65 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.483944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77ad21-8f11-4269-9ee8-b5493ed56d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.484420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77ad21-8f11-4269-9ee8-b5493ed56d65 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.485476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77ad21-8f11-4269-9ee8-b5493ed56d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:49.486025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77ad21-8f11-4269-9ee8-b5493ed56d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.487679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77ad21-8f11-4269-9ee8-b5493ed56d65 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-221b3b91-ba37-4c03-baba-c36fc7e3d509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:49.498638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:49.499840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:49.500957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:49.500957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:49.500957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:49.500957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 274/545] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:49.501999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e02f-7f37-4675-b296-de9f974faa18 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.502294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e02f-7f37-4675-b296-de9f974faa18 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.502567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2e02f-7f37-4675-b296-de9f974faa18 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.504197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 275/546] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:49.506348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2e02f-7f37-4675-b296-de9f974faa18 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.506464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 272/547] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:49.514292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce3c9-a50d-4924-a92f-318f1ae8f47a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.514583 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce3c9-a50d-4924-a92f-318f1ae8f47a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.514859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce3c9-a50d-4924-a92f-318f1ae8f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.535377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d27ce3c9-a50d-4924-a92f-318f1ae8f47a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:49.536680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d27ce3c9-a50d-4924-a92f-318f1ae8f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:49.619552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.627632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2e02f-7f37-4675-b296-de9f974faa18 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.627781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 273/548] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:49.628622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ce3c9-a50d-4924-a92f-318f1ae8f47a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.667961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee63801-ada5-43ce-9936-d5c2712a87d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.668574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee63801-ada5-43ce-9936-d5c2712a87d5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.668853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee63801-ada5-43ce-9936-d5c2712a87d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.669130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee63801-ada5-43ce-9936-d5c2712a87d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.669771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee63801-ada5-43ce-9936-d5c2712a87d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:49.670077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee63801-ada5-43ce-9936-d5c2712a87d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.671471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee63801-ada5-43ce-9936-d5c2712a87d5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.684784 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 276/549] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:49.688664 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926f98-f232-4a26-bf61-093beaa3de9d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.690084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926f98-f232-4a26-bf61-093beaa3de9d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.690671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926f98-f232-4a26-bf61-093beaa3de9d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.691874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 277/550] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:49.692407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e926f98-f232-4a26-bf61-093beaa3de9d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.705994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.750940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ce3c9-a50d-4924-a92f-318f1ae8f47a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.791405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.792494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.792921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.793333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.801350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.802150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e926f98-f232-4a26-bf61-093beaa3de9d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.802810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:49.814562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:49.815536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 274/551] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:49.816458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:49.844159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e825c-d37b-46f2-91d4-8e4c27e82803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.844987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e825c-d37b-46f2-91d4-8e4c27e82803 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.845450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e825c-d37b-46f2-91d4-8e4c27e82803 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.845748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e825c-d37b-46f2-91d4-8e4c27e82803 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.846377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e825c-d37b-46f2-91d4-8e4c27e82803 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:49.847786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e825c-d37b-46f2-91d4-8e4c27e82803 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:49.866561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 278/552] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:11:49 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:49.868895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8fe0-3089-49d5-ae41-51c3df215d85 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.869686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8fe0-3089-49d5-ae41-51c3df215d85 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.870514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8fe0-3089-49d5-ae41-51c3df215d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.896360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-291b8fe0-3089-49d5-ae41-51c3df215d85 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:49.897703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-291b8fe0-3089-49d5-ae41-51c3df215d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:49.912676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.929203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410657-3651-4c0a-a08c-9eb79feae0cf None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:49.962353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:49.981021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688169ff-f03b-43de-ae64-947581980fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:49.981669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688169ff-f03b-43de-ae64-947581980fae None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:49.981946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688169ff-f03b-43de-ae64-947581980fae None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:49.982217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688169ff-f03b-43de-ae64-947581980fae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:49.992246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688169ff-f03b-43de-ae64-947581980fae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.003358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 279/553] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 19 13:11:50.003358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8fe0-3089-49d5-ae41-51c3df215d85 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.003646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688169ff-f03b-43de-ae64-947581980fae None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-688169ff-f03b-43de-ae64-947581980fae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:50.017111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:50.018127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:50.019354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 275/554] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:11:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:50.019971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688169ff-f03b-43de-ae64-947581980fae None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.122754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8fe0-3089-49d5-ae41-51c3df215d85 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.142884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688169ff-f03b-43de-ae64-947581980fae None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.170881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.171544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.171826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.172102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.172800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:50.173101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.175197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.190486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.191422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.191725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.192010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.194391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 280/555] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:50.195466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.198358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:50.204605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:50.211644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:50.212689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:50.213536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:50.214177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 276/556] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:50.219350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.278058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:50.319801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380c89d-a0ee-4ae9-ad19-10f34e90b6e0 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.346943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecf132-a0fd-452b-b9d4-4388e5a44dec None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.355272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.355881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.356165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.356430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.357161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:50.357465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.358885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.377265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 281/557] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Oct 19 13:11:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:50.377987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.386351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.386836 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.387151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.387478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/2d5405a020ae4d61810ae01872cf325b/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.389507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=2d5405a020ae4d61810ae01872cf325b, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.390934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.419111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 277/558] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:50 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/2d5405a020ae4d61810ae01872cf325b/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:11:50.419111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.442579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:50.490223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b9bf-4804-4557-afca-2aa870e16a79 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.535805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.537003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.537428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.537876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.538718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:50.539189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.540836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.551559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 282/559] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:50.552703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.595283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df226-f334-4fb4-81d5-2a3fb4511653 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.599515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:50.636556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.637477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.637950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.638386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.639250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.640758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.662541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 278/560] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:11:50 2022] POST /identity/v3/services => generated 240 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:11:50.663690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.671615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f192c-404f-4249-ba60-e6d9b3d6524e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.710004 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:50.745179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.745911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.746197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.746472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.768509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.770025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:50.787687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:50.788725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:50.789686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:50.789686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:50.789686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:50.789686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 283/561] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:50.794809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.832498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6c5b-63f0-4635-b49d-7c5b4c3f2dfd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.902154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.902992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.903299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.903737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.919573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:50.921060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:50.939979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:50.940965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:50.941860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:50.941860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:50.941860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:50.941860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 279/562] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:50.947908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:50.952687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672c305-dcc0-41c6-9802-8b75dc7f480e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:50.968390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:50.996188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:50.997114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:50.997543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:50.998010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:50.999402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:50.999858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:51.002999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:51.020358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 284/563] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:51.025831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:51.067930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:51.072369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f261-7c67-439e-8d93-1c04ff6ff5dc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:51.108793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:51.109708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:51.110169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:51.110679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:51.112087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:51.112604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:51.114259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:51.127519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 280/564] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:51.140228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:51.160803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268ff8-4e14-4a53-8258-b9bc28ce4d5e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:51.204436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:51.206613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:51.206904 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:51.207201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:51.215451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:51.217209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:51.230628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:51.231597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:51.232480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 285/565] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:51.244675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:51.307734 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:51.358708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b884029-75bb-43ec-a5ac-ddf460498edd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:51.388516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:51.400018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ea14c-c0ee-4195-b54e-5a0abd19b749 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:51.434296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:51.434948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:51.435147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:51.435424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:51.446204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:51.446828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:51.447122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:51.447401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:51.448100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:51.448416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:51.449855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:51.452410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:51.453854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:51.468356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:51.469335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:11:51.470906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:51.473418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 281/566] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Oct 19 13:11:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:51.481322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:51.483364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 286/567] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:51.486946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:51.594604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45c9f1-d373-410b-a810-d00acbf2ae0a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:51.663808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:51.664430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:51.664710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:51.664985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:51.665726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:51.666033 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:51.667505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:51.677396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eb8aa-8cdf-4df5-9827-5146d256319a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:51.677935 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:51.708611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 282/568] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Oct 19 13:11:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:51.714982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:51.738489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:51.739404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:51.741254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:51.741538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/e5328d51705c49b2a44c47eabaa89a2b/roles/4ca7ffa01f0e4e27906254cb664bc03f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:51.771291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=e5328d51705c49b2a44c47eabaa89a2b, role_id=4ca7ffa01f0e4e27906254cb664bc03f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:51.772781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:51.795453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:51.800124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 287/569] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:11:51 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/e5328d51705c49b2a44c47eabaa89a2b/roles/4ca7ffa01f0e4e27906254cb664bc03f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:11:51.867930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab227-a171-4e9d-b66a-8b3925fefc85 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:51.915394 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8cdf-b12b-4588-8700-c196eb5e527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:51.916073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8cdf-b12b-4588-8700-c196eb5e527b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:51.916363 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8cdf-b12b-4588-8700-c196eb5e527b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:51.916639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8cdf-b12b-4588-8700-c196eb5e527b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:52.019544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:52.025808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8cdf-b12b-4588-8700-c196eb5e527b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:52.027373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8cdf-b12b-4588-8700-c196eb5e527b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:52.131030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 283/570] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:11:52.136585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:52.262892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851d13c-fa74-4406-9a1e-1840d71bc976 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:52.303513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:52.304373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:52.304800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:52.306559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ec0f0-f98b-4b3f-b823-d9e552f1d3b5 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:52.306841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ec0f0-f98b-4b3f-b823-d9e552f1d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:52.307169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ec0f0-f98b-4b3f-b823-d9e552f1d3b5 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:52.307357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:52.309179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 284/571] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:52.314333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4aa4-e9ae-4045-b6b7-eb18787e9b73 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:52.315133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4aa4-e9ae-4045-b6b7-eb18787e9b73 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:52.315609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4aa4-e9ae-4045-b6b7-eb18787e9b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:52.327254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:52.329034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:52.348687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-922c4aa4-e9ae-4045-b6b7-eb18787e9b73 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:52.350374 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-922c4aa4-e9ae-4045-b6b7-eb18787e9b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:52.357475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:52.358456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:52.359385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:52.359385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:52.359385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:52.363213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 288/572] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:52.369219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:52.447489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:52.497580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea99c9-b06b-4eba-a711-3e44fdcee402 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:52.518366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 285/573] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:11:52.553777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:52.554318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:52.554595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:52.554867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:52.555551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:52.555858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:52.557239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:52.578161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 289/574] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:52.583985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4aa4-e9ae-4045-b6b7-eb18787e9b73 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:52.620475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:52.707307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4aa4-e9ae-4045-b6b7-eb18787e9b73 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:52.754613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:52.755279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:52.755562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:52.755836 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:52.762993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:52.764482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:52.778969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:52.779956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:52.780873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 286/575] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:52.786466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:52.920829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00451f02-469f-4f67-8bec-ee0deb1a91d6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:52.929794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:52.945530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:52.992389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:52.994014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:52.994718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:52.996682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:52.998203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:52.999339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:53.000986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:53.027957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 290/576] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:53.036083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:53.102524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:53.149296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7487a81-d77f-4c8f-aad3-121e102d5590 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:53.152815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e624cb-fd4d-46f4-aa7d-090c8a7a6865 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:53.202521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f12ca2-6859-4350-bd05-ceb4f76d9def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:53.203232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12ca2-6859-4350-bd05-ceb4f76d9def None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.203500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12ca2-6859-4350-bd05-ceb4f76d9def None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.203769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f12ca2-6859-4350-bd05-ceb4f76d9def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.204502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f12ca2-6859-4350-bd05-ceb4f76d9def None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=c1433a2c778346a09a10845139967c27) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:53.205371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f12ca2-6859-4350-bd05-ceb4f76d9def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:53.206796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f12ca2-6859-4350-bd05-ceb4f76d9def None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:53.218444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 291/577] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:53 2022] GET /identity/v3/role_assignments?user.id=c1433a2c778346a09a10845139967c27&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:53.219525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:53.220163 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.220473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.220745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.221333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:53.222863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:53.224992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8352c-611c-4de5-bedf-46c6f9e93042 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.225526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8352c-611c-4de5-bedf-46c6f9e93042 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.226027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8352c-611c-4de5-bedf-46c6f9e93042 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.231232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 292/578] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:53.234276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d05d-a6a7-4856-ae87-6097fe5a84ee None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.234816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d05d-a6a7-4856-ae87-6097fe5a84ee None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.235370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d05d-a6a7-4856-ae87-6097fe5a84ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:53.241357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:53.242422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:53.243998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 287/579] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Oct 19 13:11:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:53.249997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:53.260848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-89c9d05d-a6a7-4856-ae87-6097fe5a84ee None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:53.262492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-89c9d05d-a6a7-4856-ae87-6097fe5a84ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:53.341556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:53.443544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 293/580] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:11:53.445382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78aa4e-4eae-4eff-811e-f7f23bd16ba6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:53.450343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3222c-b081-4c61-a51f-e8b8332bc447 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.450821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3222c-b081-4c61-a51f-e8b8332bc447 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.450901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3222c-b081-4c61-a51f-e8b8332bc447 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.452486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 294/581] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:53.457840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa09c3-3624-4a7e-b7c2-5d766843ae5e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.458122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa09c3-3624-4a7e-b7c2-5d766843ae5e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.458400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa09c3-3624-4a7e-b7c2-5d766843ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.477029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a5fa09c3-3624-4a7e-b7c2-5d766843ae5e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:53.478210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a5fa09c3-3624-4a7e-b7c2-5d766843ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:53.488857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:53.489855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.490157 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.490431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.491376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:53.491684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:53.493856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:53.500176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 288/582] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Oct 19 13:11:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:53.505936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:53.527251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:53.559719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 295/583] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:11:53.633234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3262d4b-49a4-4128-9216-08d01b631ba1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:53.670962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:53.672002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.672487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.672965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.674344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:53.674864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:53.676459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:53.681833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 289/584] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Oct 19 13:11:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:53.687457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa09c3-3624-4a7e-b7c2-5d766843ae5e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:53.745187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:53.856547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:53.864408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa09c3-3624-4a7e-b7c2-5d766843ae5e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:53.894221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:53.905726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:53.906555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.906987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.907504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.909005 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] RBAC: Adding query filter params (interface=public, service_id=1aa855a8a4ec4128a0fad36c7b035844, region_id=RegionOne) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:53.909479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:53.911121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:53.919781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 296/585] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:11:53 2022] GET /identity/v3/endpoints?service_id=1aa855a8a4ec4128a0fad36c7b035844&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:53.920833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:53.921424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6806-47c0-4fe2-a407-791500e0f858 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:53.964241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:53.964941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:53.965741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:53.966027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:53.984024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:53.992878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:53.994109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 290/586] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:53.999975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.044229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0e6e7-9999-4e4b-b963-03f414ac9f7f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.084252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.085083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.085463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.085864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.086726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:54.089022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:54.100368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:54.101656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:54.102677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:54.104634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 297/587] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:53 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:54.105686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.131860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119f58-6fb5-40fb-98b0-530b921ed4f2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.137154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:54.180473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.181602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.182042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.183041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.183854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:54.185963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:54.192023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:54.199248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 291/588] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:11:53 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:54.200852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.240102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de40768-6c5d-491b-ae5a-96257fe0e5e2 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.309964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.310516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.310795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.311068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.311787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:54.312094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:54.313958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:54.336482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 298/589] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:54.349658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.404418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faa4c7-0577-4c5e-a269-8763ff0c5957 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.446816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.448257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.448545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.448820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.449796 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] RBAC: Adding query filter params (name=network) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:54.450104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:54.452889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:54.462466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 292/590] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:11:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:54.468198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.471452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:54.489671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7085488-3442-43f5-8e82-5329e5bcf19a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.531792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470171-3f82-4a1e-aafc-9e1a3cf9062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.532701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470171-3f82-4a1e-aafc-9e1a3cf9062e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.533158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470171-3f82-4a1e-aafc-9e1a3cf9062e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.533582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470171-3f82-4a1e-aafc-9e1a3cf9062e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.545854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:54.551211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0470171-3f82-4a1e-aafc-9e1a3cf9062e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:54.553195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0470171-3f82-4a1e-aafc-9e1a3cf9062e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-d0470171-3f82-4a1e-aafc-9e1a3cf9062e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:54.569192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:54.570170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:54.571052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:54.571052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:54.571052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:54.571052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 299/591] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:54.571819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3c97f-0785-46a0-9fdb-4cf4ba73191c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.572114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3c97f-0785-46a0-9fdb-4cf4ba73191c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.572372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3c97f-0785-46a0-9fdb-4cf4ba73191c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.575151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 300/592] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:54.576111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3c97f-0785-46a0-9fdb-4cf4ba73191c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.601957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574854-608a-43ce-b635-71aee2011b77 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.639152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5516e-e0df-433f-8fb3-666e2fd94c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.639767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5516e-e0df-433f-8fb3-666e2fd94c33 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.640334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5516e-e0df-433f-8fb3-666e2fd94c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.640463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5516e-e0df-433f-8fb3-666e2fd94c33 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.641117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5516e-e0df-433f-8fb3-666e2fd94c33 None admin] RBAC: Adding query filter params (type=network) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:54.641424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5516e-e0df-433f-8fb3-666e2fd94c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:54.643453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5516e-e0df-433f-8fb3-666e2fd94c33 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:54.653894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 293/593] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:11:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:54.655321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf641-7f81-47f4-9383-303daa58e1c9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.655609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf641-7f81-47f4-9383-303daa58e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.655888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf641-7f81-47f4-9383-303daa58e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.676315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-af6bf641-7f81-47f4-9383-303daa58e1c9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:54.677586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-af6bf641-7f81-47f4-9383-303daa58e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:54.698943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3c97f-0785-46a0-9fdb-4cf4ba73191c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.739571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.740569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.741095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.741562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:54.742467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:54.743165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:54.745429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:54.759042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 301/595] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:54.759444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:54.759562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 294/595] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:11:54.760947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.764151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf641-7f81-47f4-9383-303daa58e1c9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:54.879437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:54.934094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fff79-c646-47f3-afca-121bdf3c1f93 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.950924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf641-7f81-47f4-9383-303daa58e1c9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:54.998274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:54.998892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:54.999190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:54.999457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.000159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] RBAC: Adding query filter params (interface=public, service_id=12781a92014746c0a2a4f33a676ef1db, region_id=RegionOne) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:55.000594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:55.002601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:55.007016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:55.007747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.008037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 302/596] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:11:54 2022] GET /identity/v3/endpoints?service_id=12781a92014746c0a2a4f33a676ef1db&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:55.008327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.008610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.013583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:55.028813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:55.030260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:55.050617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:55.051645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:55.053277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 295/597] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:11:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:11:55.057341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:55.117665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:55.166972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e9d0-9c63-421b-b9b0-ea9666879bce None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:55.176001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160911dd-056a-4014-ac00-bb5b8a340eb1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:55.195248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:55.214112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:55.214899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.215322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.215672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.216578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:55.216852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:55.216987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:55.217765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.218220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.218612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:55.218855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.219678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:55.222688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:55.230203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 303/598] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:11:55 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:55.231367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:55.242465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 296/599] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Oct 19 13:11:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:55.254877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:55.421555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b44d5-e909-421e-a812-fd2ad4400cf5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:55.473587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed58d6-8c00-49a2-b0aa-753818aebb29 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:55.476418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:55.485307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f000-c95a-4675-966e-945ba255774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:55.486819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f000-c95a-4675-966e-945ba255774e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.487250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f000-c95a-4675-966e-945ba255774e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.487624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f000-c95a-4675-966e-945ba255774e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.500831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505f000-c95a-4675-966e-945ba255774e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-0505f000-c95a-4675-966e-945ba255774e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:11:55.508203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:55.509421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:11:55.510488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:55.511387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 304/600] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:55.517807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f000-c95a-4675-966e-945ba255774e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:55.519315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c50b2a-1c52-43f8-ba2b-5fcfefb7b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:55.519933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50b2a-1c52-43f8-ba2b-5fcfefb7b1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.520209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50b2a-1c52-43f8-ba2b-5fcfefb7b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.520479 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50b2a-1c52-43f8-ba2b-5fcfefb7b1e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.583825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:55.623802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50b2a-1c52-43f8-ba2b-5fcfefb7b1e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:55.627882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50b2a-1c52-43f8-ba2b-5fcfefb7b1e7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:55.677921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f000-c95a-4675-966e-945ba255774e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:55.759914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc225f8-7446-432e-95cf-8a32288d0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:55.762489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc225f8-7446-432e-95cf-8a32288d0a8a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.762771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc225f8-7446-432e-95cf-8a32288d0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.763048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc225f8-7446-432e-95cf-8a32288d0a8a None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.764862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc225f8-7446-432e-95cf-8a32288d0a8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:55.765191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc225f8-7446-432e-95cf-8a32288d0a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:55.766583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc225f8-7446-432e-95cf-8a32288d0a8a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:55.797327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 305/601] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:55.802804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188547-861e-4833-823b-2f15f2da88a4 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.803122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188547-861e-4833-823b-2f15f2da88a4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.803439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188547-861e-4833-823b-2f15f2da88a4 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.805163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 306/602] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:11:55.805883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188547-861e-4833-823b-2f15f2da88a4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:55.812965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 297/603] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:11:55.820415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5fec3-e4ae-44d2-ab54-48ba9613cc8b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.820710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5fec3-e4ae-44d2-ab54-48ba9613cc8b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.820997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5fec3-e4ae-44d2-ab54-48ba9613cc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:55.846747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0cf5fec3-e4ae-44d2-ab54-48ba9613cc8b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:55.847978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0cf5fec3-e4ae-44d2-ab54-48ba9613cc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:55.864993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:55.923505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188547-861e-4833-823b-2f15f2da88a4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:55.941755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 298/604] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:11:55.942558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5fec3-e4ae-44d2-ab54-48ba9613cc8b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:55.951581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:55.984403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:55.985049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:55.985332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:55.985607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.012541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.014242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:56.046863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:56.047878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:56.048818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:56.048818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:56.048818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:56.048818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 307/605] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:56.053963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.082909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5fec3-e4ae-44d2-ab54-48ba9613cc8b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.122362 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.123002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.123446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.123727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.136178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.137916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:56.156189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:56.157175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:56.158148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:56.158148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:56.158148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:56.158320 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 299/606] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:56.163885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.262572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:56.264879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51eb8b-0012-46a3-83c7-048b2858bb61 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.288622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:56.302045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.302673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.302959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.303273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.303928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:56.304241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.305635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.319069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 308/607] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:56.324305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.358021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2274b4-6c5c-4ad8-9fc3-2df50b7ba2ae None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.407005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.408446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.409345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.409842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.410946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:56.412023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.414151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.430459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceb6aa-435c-404c-9b9e-61326c2d381c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.434059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 300/608] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:56.435889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.473695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.474763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.475055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.475375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.476290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.477739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:56.488629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:56.489821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:11:56.490704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:56.491485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 309/609] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:56.492436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.523608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:56.571862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e172-67d7-4be6-9550-8a2dd01ff7f0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.594556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:56.607380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed7cd-8e42-44af-84ce-1a2834f76b5f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.615585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.616414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.616699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.616979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.624080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.625531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:11:56.639458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:56.640439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 301/610] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:56.641426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.650279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73744848-2fc3-4e0d-b36c-edb3b944ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.651207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73744848-2fc3-4e0d-b36c-edb3b944ba94 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.651693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73744848-2fc3-4e0d-b36c-edb3b944ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.652160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73744848-2fc3-4e0d-b36c-edb3b944ba94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.659411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73744848-2fc3-4e0d-b36c-edb3b944ba94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.661867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73744848-2fc3-4e0d-b36c-edb3b944ba94 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-73744848-2fc3-4e0d-b36c-edb3b944ba94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:56.675823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:56.676732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:56.677644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:56.678088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 310/611] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:56.679250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd398-44ac-47c9-83dc-4966d28a7289 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.679449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd398-44ac-47c9-83dc-4966d28a7289 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.679720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd398-44ac-47c9-83dc-4966d28a7289 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.681115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 311/612] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:56.681649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bd398-44ac-47c9-83dc-4966d28a7289 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.754877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84f42-ae4a-48b6-9d1a-debc9b8627df None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.781055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:56.789878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.790498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.790784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.791064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.791727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:56.792037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.793433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.797817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 302/613] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:56.799191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.807305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bd398-44ac-47c9-83dc-4966d28a7289 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.845066 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54097-75be-4020-823d-e3a7aec9c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.846346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54097-75be-4020-823d-e3a7aec9c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.846701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:56.846815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54097-75be-4020-823d-e3a7aec9c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.846987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54097-75be-4020-823d-e3a7aec9c7f5 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.847863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54097-75be-4020-823d-e3a7aec9c7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:56.848181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54097-75be-4020-823d-e3a7aec9c7f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.849778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54097-75be-4020-823d-e3a7aec9c7f5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.869045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 312/614] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:56.870474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7018-b6cb-4f11-b94d-1ac20ce6ee70 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.870768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7018-b6cb-4f11-b94d-1ac20ce6ee70 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.871052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b7018-b6cb-4f11-b94d-1ac20ce6ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.890462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-774b7018-b6cb-4f11-b94d-1ac20ce6ee70 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:56.891874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-774b7018-b6cb-4f11-b94d-1ac20ce6ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:56.912478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180d6e0-b9ee-4dcd-aad0-3a003c6c7043 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:56.948087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:56.948703 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:56.948990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:56.949254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:56.950061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:56.950373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:56.951973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:56.967104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 313/615] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:11:56.967104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7018-b6cb-4f11-b94d-1ac20ce6ee70 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:56.973760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 303/616] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:56.974649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:57.044533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:57.077000 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b7018-b6cb-4f11-b94d-1ac20ce6ee70 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:57.114814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dbc84-bbeb-4068-b767-1447c9ecfba9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:57.115071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:57.115847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.116253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.116366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:57.117065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.117893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:57.120891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:57.120891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:57.127458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 314/617] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:57.128642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:57.162175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:57.163396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.163818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.164222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.273536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036096-69ea-4aa2-b38d-7001b2915e6b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:57.314831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:57.315420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.315699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.315975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.316738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=2d5405a020ae4d61810ae01872cf325b) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:57.317049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:57.319232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:57.323459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:57.327953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 315/618] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:57 2022] GET /identity/v3/role_assignments?user.id=2d5405a020ae4d61810ae01872cf325b&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:57.330670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:57.332161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:57.334881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:57.476017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 304/619] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:11:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:11:57.483726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:57.486720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:57.530434 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084e9db-bc54-4fa4-b71a-bf9a580e6252 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:57.579945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:57.580530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.580808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.581081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.581683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:57.583258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:57.603443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:57.604532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:11:57.605402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 316/620] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Oct 19 13:11:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:57.613031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:57.670119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1d798-9131-44c7-b323-b13bded33b07 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:57.707562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:57.735397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8193ed-2120-4c1e-8898-c5182dd0ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:57.736930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8193ed-2120-4c1e-8898-c5182dd0ecfb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.737359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8193ed-2120-4c1e-8898-c5182dd0ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.737846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8193ed-2120-4c1e-8898-c5182dd0ecfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.752343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeef543-d256-4f99-96bd-818adb1fe147 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:57.752639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8193ed-2120-4c1e-8898-c5182dd0ecfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:57.754503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8193ed-2120-4c1e-8898-c5182dd0ecfb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-db8193ed-2120-4c1e-8898-c5182dd0ecfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:11:57.777289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:57.778621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:11:57.779799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:11:57.779799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:11:57.779799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:57.781047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 305/621] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:57.782416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff715a86-8d11-497c-b9b5-3f14542e1d6d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.783276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff715a86-8d11-497c-b9b5-3f14542e1d6d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.783650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff715a86-8d11-497c-b9b5-3f14542e1d6d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.785170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 306/622] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:57.790057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff715a86-8d11-497c-b9b5-3f14542e1d6d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:57.803912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515056b-6485-4ba8-a324-71ad30e7a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:57.805241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515056b-6485-4ba8-a324-71ad30e7a809 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.805948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515056b-6485-4ba8-a324-71ad30e7a809 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.806395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515056b-6485-4ba8-a324-71ad30e7a809 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.807323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515056b-6485-4ba8-a324-71ad30e7a809 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:57.807777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515056b-6485-4ba8-a324-71ad30e7a809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:57.809418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515056b-6485-4ba8-a324-71ad30e7a809 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:57.819917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 317/623] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Oct 19 13:11:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:57.821010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632cb2-1205-4fb3-b28f-db0ff88440df None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.821255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632cb2-1205-4fb3-b28f-db0ff88440df None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.821605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632cb2-1205-4fb3-b28f-db0ff88440df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.843047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e7632cb2-1205-4fb3-b28f-db0ff88440df None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:57.844515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e7632cb2-1205-4fb3-b28f-db0ff88440df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:57.867672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:57.923752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 318/624] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:11:57.924969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632cb2-1205-4fb3-b28f-db0ff88440df None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:57.942160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff715a86-8d11-497c-b9b5-3f14542e1d6d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:57.993116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:57.993996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:57.994455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:57.994880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:57.995710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:57.996164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:57.998190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.011913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 307/625] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:58.023101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:58.038429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:58.117527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632cb2-1205-4fb3-b28f-db0ff88440df None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.190960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.191821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.192704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.193272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.194070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:58.194595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:58.196915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.207665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 319/626] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Oct 19 13:11:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:58.213095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:58.231136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb26e5-a5b3-4837-863f-8a2548292c07 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.253845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:58.277624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.278793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.279448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.279794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.287590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:58.289132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:11:58.301648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:58.302582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:58.303527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 308/627] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:58.304029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:58.335029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ce0c-6a0b-4202-b573-53c495594402 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.359351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:58.376165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.377627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.378641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.379145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.380273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:58.382832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.416446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 320/628] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:11:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:11:58.421993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:58.460445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb499-04ca-46e6-a4d7-ee6870904cc2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.542328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.542981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.543283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.543613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] PATH_INFO: `/v3/services/network` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.544265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:58.545714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:11:58.555912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:11:58.556988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:11:58.557835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 309/629] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:11:58 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:11:58.562971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:58.603422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:58.642153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9a61a-89b4-46ee-a61e-a0d1041c08ba None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.684362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.684980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.685267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.685544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.686246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:58.686555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:58.688051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.703250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 321/630] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:11:58.708672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:58.719917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509333-c0b1-4ccf-b751-98a7ec363a6c None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.758530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:58.769074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.770400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.770905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.771672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.772512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] RBAC: Adding query filter params (name=network) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:58.773175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:58.775047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.783053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 310/631] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:11:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:58.788538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:58.841484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ba5e5-f9f4-433e-b439-67b0ce1ad03f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.881974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.882995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.883787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.884295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.885716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] RBAC: Adding query filter params (role.id=4ca7ffa01f0e4e27906254cb664bc03f, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=e5328d51705c49b2a44c47eabaa89a2b) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:58.886263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:58.887931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:58.895509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 322/632] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:11:58 2022] GET /identity/v3/role_assignments?user.id=e5328d51705c49b2a44c47eabaa89a2b&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=4ca7ffa01f0e4e27906254cb664bc03f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:58.937371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:58.943145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38666b2-edd2-4635-aad6-67b071694abd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:58.996880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b4b13-77d6-41da-9376-b735511a01a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:58.997897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b4b13-77d6-41da-9376-b735511a01a0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:58.998392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b4b13-77d6-41da-9376-b735511a01a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:58.998889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b4b13-77d6-41da-9376-b735511a01a0 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:58.999865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b4b13-77d6-41da-9376-b735511a01a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:11:59.000409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b4b13-77d6-41da-9376-b735511a01a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:59.002174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b4b13-77d6-41da-9376-b735511a01a0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:59.014075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 311/633] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:11:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:11:59.019596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:59.138439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351be9b3-eef0-49d5-8fa1-e9989016300e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:11:59.140447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:11:59.176243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496580a-5b5d-49a1-a8c6-61d9863b9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:11:59.177198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496580a-5b5d-49a1-a8c6-61d9863b9647 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:59.177719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496580a-5b5d-49a1-a8c6-61d9863b9647 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:59.178193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496580a-5b5d-49a1-a8c6-61d9863b9647 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:59.179104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496580a-5b5d-49a1-a8c6-61d9863b9647 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:11:59.180917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496580a-5b5d-49a1-a8c6-61d9863b9647 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:11:59.208487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 323/634] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:11:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:11:59.531346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4383d19-cc9d-4d27-b0c2-9730c213e112 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:59.531539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4383d19-cc9d-4d27-b0c2-9730c213e112 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:59.531828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4383d19-cc9d-4d27-b0c2-9730c213e112 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:59.534071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 312/635] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:11:59.541122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e554860-dd69-4c9d-8af4-230260d1a96c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:11:59.541439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e554860-dd69-4c9d-8af4-230260d1a96c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:11:59.541701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e554860-dd69-4c9d-8af4-230260d1a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:11:59.562723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5e554860-dd69-4c9d-8af4-230260d1a96c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:11:59.564078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5e554860-dd69-4c9d-8af4-230260d1a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:11:59.658358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 324/636] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:11:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:11:59.949692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4383d19-cc9d-4d27-b0c2-9730c213e112 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:11:59.999517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e71f2e-5b01-4c82-bb55-b4bf57a82524 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:00.000172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e71f2e-5b01-4c82-bb55-b4bf57a82524 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:00.000833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e71f2e-5b01-4c82-bb55-b4bf57a82524 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:00.002709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 325/637] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:00.008183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644532-f6b1-4e44-bdef-82beefd74bbc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:00.008735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644532-f6b1-4e44-bdef-82beefd74bbc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:00.009229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644532-f6b1-4e44-bdef-82beefd74bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:00.029223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-23644532-f6b1-4e44-bdef-82beefd74bbc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:00.030779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-23644532-f6b1-4e44-bdef-82beefd74bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:00.061898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4383d19-cc9d-4d27-b0c2-9730c213e112 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:00.098724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:00.099756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:00.100204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:00.100869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:00.101716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:00.103380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:00.113145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 326/638] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:00.127975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 313/639] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:11:59 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:00.389471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23644532-f6b1-4e44-bdef-82beefd74bbc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:00.405466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:00.493867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23644532-f6b1-4e44-bdef-82beefd74bbc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:00.535899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:00.536970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:00.537478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:00.537970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:00.538759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:00.540386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:00.549893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:00.551008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:00.552002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:00.554894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 327/640] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:00.565049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:00.590235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:00.670001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815ed5f-0ae1-4476-8feb-417a1b645722 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:00.705183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b48f83-a8dc-47ee-a3ed-b77fa85bef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:00.705808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b48f83-a8dc-47ee-a3ed-b77fa85bef14 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:00.706093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b48f83-a8dc-47ee-a3ed-b77fa85bef14 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:00.706373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b48f83-a8dc-47ee-a3ed-b77fa85bef14 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:00.707015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b48f83-a8dc-47ee-a3ed-b77fa85bef14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:00.707361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b48f83-a8dc-47ee-a3ed-b77fa85bef14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:00.708751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b48f83-a8dc-47ee-a3ed-b77fa85bef14 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:00.718415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 314/641] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:00.719902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:00.797247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:00.824236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98851b06-be9f-4022-bdf9-2908fa3dfa1b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:00.858619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e7431-e819-4eac-858d-bc1cdef2eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:00.859279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7431-e819-4eac-858d-bc1cdef2eee8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:00.859625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7431-e819-4eac-858d-bc1cdef2eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:00.859912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7431-e819-4eac-858d-bc1cdef2eee8 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:00.860550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e7431-e819-4eac-858d-bc1cdef2eee8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:00.861368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e7431-e819-4eac-858d-bc1cdef2eee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:00.862763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e7431-e819-4eac-858d-bc1cdef2eee8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:00.875302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 328/642] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:00.994378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d600186-0cda-4f6e-9206-320ea9de2b69 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:00.994897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d600186-0cda-4f6e-9206-320ea9de2b69 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:00.994897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d600186-0cda-4f6e-9206-320ea9de2b69 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:00.996583 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 315/643] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:01.002338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f561-3434-432e-9abc-4fad28c2df3c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:01.002846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f561-3434-432e-9abc-4fad28c2df3c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:01.003371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f561-3434-432e-9abc-4fad28c2df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:01.023457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a367f561-3434-432e-9abc-4fad28c2df3c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:01.025041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a367f561-3434-432e-9abc-4fad28c2df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:01.097502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 329/644] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:01.377290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d600186-0cda-4f6e-9206-320ea9de2b69 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:01.468745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:01.473165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97bbc-6488-4b79-9935-530e2b9b9214 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:01.474459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97bbc-6488-4b79-9935-530e2b9b9214 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:01.474949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97bbc-6488-4b79-9935-530e2b9b9214 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:01.477144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 330/645] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:01.482330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789563d5-fb7e-47c0-8b29-a977761ff4f1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:01.482891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789563d5-fb7e-47c0-8b29-a977761ff4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:01.483524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789563d5-fb7e-47c0-8b29-a977761ff4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:01.488127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d600186-0cda-4f6e-9206-320ea9de2b69 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:01.503978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-789563d5-fb7e-47c0-8b29-a977761ff4f1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:01.505486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-789563d5-fb7e-47c0-8b29-a977761ff4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:01.525662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:01.526816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:01.527378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:01.528003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:01.528595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:01.530021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:01.540381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:01.541420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:01.542275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 316/646] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:01.547192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:01.577721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:01.586733 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 331/647] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:01.662438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4c22-f33f-458f-a125-251b4456cf7d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:01.698646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:01.699359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:01.699644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:01.699920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:01.700558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:01.700869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:01.702260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:01.707894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 317/648] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:01.713377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789563d5-fb7e-47c0-8b29-a977761ff4f1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:01.818660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789563d5-fb7e-47c0-8b29-a977761ff4f1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:01.850579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:01.855128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:01.855920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:01.856355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:01.856774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:01.857613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:01.858076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:01.859641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:01.865464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 332/649] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:01.871000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:01.971430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213cfe6-a10a-4ae8-bfa7-05e108783845 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:02.009088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:02.010442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.010882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.011354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.027963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:02.034230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:02.035263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:02.036177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 318/650] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Oct 19 13:12:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:02.041432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:02.109070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:02.154786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6148-b398-4f7e-a8e8-c8459e5530df None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:02.198325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:02.199292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.199782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.200272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.201145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:02.201648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:02.203292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:02.211981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 333/651] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Oct 19 13:12:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:02.217710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:02.299598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:02.322645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b74527-4f94-4548-b74c-dec926ad6f04 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:02.357522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:02.358159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.358443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.358720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.370251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:02.371829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:02.386519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:02.387536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:02.388462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:02.388462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:02.388462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:02.388462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 319/652] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:02.394991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:02.503765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3244-ad64-42fb-a561-704ad77a9ef2 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:02.527783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:02.538742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20f589-6f6d-4fd1-8920-51256b098249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:02.539387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f589-6f6d-4fd1-8920-51256b098249 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.539670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f589-6f6d-4fd1-8920-51256b098249 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.539946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f589-6f6d-4fd1-8920-51256b098249 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.540597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20f589-6f6d-4fd1-8920-51256b098249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:02.540911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20f589-6f6d-4fd1-8920-51256b098249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:02.542278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20f589-6f6d-4fd1-8920-51256b098249 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:02.555395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 334/653] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:02.560549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:02.565413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92487871-1c23-4a23-8925-461d713d5a05 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.565696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92487871-1c23-4a23-8925-461d713d5a05 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.565967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92487871-1c23-4a23-8925-461d713d5a05 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.567447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 335/654] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:02.572330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18552809-0190-436c-8864-bf5c1ef121b3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.572611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18552809-0190-436c-8864-bf5c1ef121b3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.572887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18552809-0190-436c-8864-bf5c1ef121b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.591360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-18552809-0190-436c-8864-bf5c1ef121b3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:02.592545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-18552809-0190-436c-8864-bf5c1ef121b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:02.687652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 336/655] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:02 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:02.693872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d1ae5-7493-4ad3-9afc-e49197403e1d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:02.724160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:02.733864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:02.734502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.734785 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.735060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.743534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:02.744996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:12:02.756350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:02.757319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:02.758868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 320/656] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:12:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:02.763627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18552809-0190-436c-8864-bf5c1ef121b3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:02.875317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18552809-0190-436c-8864-bf5c1ef121b3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:02.899439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:02.911110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:02.911921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:02.912261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:02.912781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:02.913515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:02.913818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:02.915285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:02.935897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 337/657] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Oct 19 13:12:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:02.948250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.020386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.065301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3547dd7-904e-44a8-86dc-7a684db0f4b3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.104217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.104853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.105137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.105416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.117225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.118685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:03.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:03.134455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:03.135403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:03.135403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:03.135403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:03.135403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 321/658] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:03.135637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce5bda-964f-4b21-921e-aeb510a1526e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.141112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.190696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:03.192902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c63f-48da-42ed-968a-34718aab79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.193489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c63f-48da-42ed-968a-34718aab79a4 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.193788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c63f-48da-42ed-968a-34718aab79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.193999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c63f-48da-42ed-968a-34718aab79a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.194662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c63f-48da-42ed-968a-34718aab79a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.196084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c63f-48da-42ed-968a-34718aab79a4 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-cbe5c63f-48da-42ed-968a-34718aab79a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:03.206380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:03.207389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:03.208276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 338/659] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:03.209112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d4fd1-6720-4fa5-b3ae-4e76c73e0eec None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.209112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d4fd1-6720-4fa5-b3ae-4e76c73e0eec None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.209911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d4fd1-6720-4fa5-b3ae-4e76c73e0eec None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.210780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 339/660] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:03.213272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d4fd1-6720-4fa5-b3ae-4e76c73e0eec None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.255993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:03.260327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6331-5287-4d11-a2c5-9a9a74655a46 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.294233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8650c-28cb-4d4b-8d2d-df8a7f5f64ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.294847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8650c-28cb-4d4b-8d2d-df8a7f5f64ee None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.295152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8650c-28cb-4d4b-8d2d-df8a7f5f64ee None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.295433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8650c-28cb-4d4b-8d2d-df8a7f5f64ee None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.296079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8650c-28cb-4d4b-8d2d-df8a7f5f64ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:03.296385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8650c-28cb-4d4b-8d2d-df8a7f5f64ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.297830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8650c-28cb-4d4b-8d2d-df8a7f5f64ee None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.310862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 322/661] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:03.312113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b603-46e7-4733-998b-858102323b7c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.312405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b603-46e7-4733-998b-858102323b7c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.312683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b603-46e7-4733-998b-858102323b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.331553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cdc1b603-46e7-4733-998b-858102323b7c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:03.332736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cdc1b603-46e7-4733-998b-858102323b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:03.334042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d4fd1-6720-4fa5-b3ae-4e76c73e0eec None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.372076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.372690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.372978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.373253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.373885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:03.374196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.375601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.385034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 340/662] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:03.385034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.407684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 323/663] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:03 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:03.408911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1b603-46e7-4733-998b-858102323b7c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.454023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:03.493305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:03.498427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cfbef-6c10-4f96-a163-12f4f71a4bdc None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.538105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.538737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.539015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.539310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.546183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.547764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.555903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1b603-46e7-4733-998b-858102323b7c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:12:03.559118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:03.560116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:03.561039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:03.565749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 341/664] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:03.566677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.628030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.629053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.630074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.630562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.631704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:03.632510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.634849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.646846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 324/665] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:03.648224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.681994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a219567-1d7e-41d7-a28c-2ac1c133d446 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.721207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.721826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.722135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.722382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.723114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:03.723415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.724920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.737407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 342/666] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:03.738298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.772670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:03.778947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:03.790011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563634d-d72a-48cd-a8bb-82e3446113df None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.828175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.828782 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.829059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.829329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.830629 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] RBAC: Adding query filter params (interface=public, service_id=7bcb1cbcb78741e9bbbafb0396f21913, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:03.830944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.832469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.840918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 325/667] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/endpoints?service_id=7bcb1cbcb78741e9bbbafb0396f21913&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:03.841816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.862634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db13c3-fb27-4133-83a5-03970595cd6c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:03.901521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:03.902139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:03.902687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:03.902687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:03.903277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:03.904654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:03.921136 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 343/668] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:12:03 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:03.922402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:03.984426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85561689-01c9-406e-ae22-29b3b5008e9f None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:04.027036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:04.053616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72120f91-3400-46fb-a8b0-7568ad79bed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:04.054723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120f91-3400-46fb-a8b0-7568ad79bed6 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:04.055179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69d76c-403e-4d74-86cd-c309ee5663f5 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:04.055440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120f91-3400-46fb-a8b0-7568ad79bed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:04.055926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120f91-3400-46fb-a8b0-7568ad79bed6 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/e5328d51705c49b2a44c47eabaa89a2b/roles/254a0165ac6d4047a8971107a6d9e9fa` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:04.060077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72120f91-3400-46fb-a8b0-7568ad79bed6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=e5328d51705c49b2a44c47eabaa89a2b, role_id=254a0165ac6d4047a8971107a6d9e9fa)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:04.061068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72120f91-3400-46fb-a8b0-7568ad79bed6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:04.080611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 326/669] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:12:03 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/e5328d51705c49b2a44c47eabaa89a2b/roles/254a0165ac6d4047a8971107a6d9e9fa => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:12:04.116311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25076f-3571-4d09-bb40-8559fc0bf633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:04.117059 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25076f-3571-4d09-bb40-8559fc0bf633 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:04.117506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25076f-3571-4d09-bb40-8559fc0bf633 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:04.117963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25076f-3571-4d09-bb40-8559fc0bf633 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:04.119023 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25076f-3571-4d09-bb40-8559fc0bf633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:04.120720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25076f-3571-4d09-bb40-8559fc0bf633 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:04.127912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 344/670] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:12:03 2022] GET /identity/v3/services => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:12:04.192563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173a1-0982-4d49-b9b8-78f7938d01fd None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:04.193230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173a1-0982-4d49-b9b8-78f7938d01fd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:04.193728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173a1-0982-4d49-b9b8-78f7938d01fd None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:04.196081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 327/671] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:04.202692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a7aae-4f35-43b4-ace9-d055ec5c7c19 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:04.203005 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a7aae-4f35-43b4-ace9-d055ec5c7c19 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:04.203280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a7aae-4f35-43b4-ace9-d055ec5c7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:04.224142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-225a7aae-4f35-43b4-ace9-d055ec5c7c19 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:04.225427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-225a7aae-4f35-43b4-ace9-d055ec5c7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:04.306883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 345/672] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:04 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:04.586118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173a1-0982-4d49-b9b8-78f7938d01fd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:04.603009 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:04.700336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173a1-0982-4d49-b9b8-78f7938d01fd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:04.737077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e3bdc-6fa7-4c38-892c-f4c1631d3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:04.738045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3bdc-6fa7-4c38-892c-f4c1631d3305 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:04.738552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3bdc-6fa7-4c38-892c-f4c1631d3305 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:04.739000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3bdc-6fa7-4c38-892c-f4c1631d3305 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:04.739932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e3bdc-6fa7-4c38-892c-f4c1631d3305 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:04.741505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e3bdc-6fa7-4c38-892c-f4c1631d3305 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:04.757425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 328/673] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:12:04 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:06.199543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5f8cf-5f49-4244-b1c6-91033902caa7 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.199982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5f8cf-5f49-4244-b1c6-91033902caa7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.200194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5f8cf-5f49-4244-b1c6-91033902caa7 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.201869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 346/674] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:06.207203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf87ce-dd33-4c1b-bb7d-bd60a91da847 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.207598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf87ce-dd33-4c1b-bb7d-bd60a91da847 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.207778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf87ce-dd33-4c1b-bb7d-bd60a91da847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.226375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e8cf87ce-dd33-4c1b-bb7d-bd60a91da847 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:06.227625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e8cf87ce-dd33-4c1b-bb7d-bd60a91da847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:06.263834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385db7c-eade-4854-a15f-cf11cf90540c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.264136 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385db7c-eade-4854-a15f-cf11cf90540c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.264393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385db7c-eade-4854-a15f-cf11cf90540c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.265730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 347/675] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:12:06.270944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfda67-41d8-4162-99f0-efe3739d5f89 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.271260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfda67-41d8-4162-99f0-efe3739d5f89 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.271538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfda67-41d8-4162-99f0-efe3739d5f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.289898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5ebfda67-41d8-4162-99f0-efe3739d5f89 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:06.291544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5ebfda67-41d8-4162-99f0-efe3739d5f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:06.301338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:06.309140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 329/676] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:06.365990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 348/677] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:06.411037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92089-0b45-4350-b503-041ac3ec792e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.411359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92089-0b45-4350-b503-041ac3ec792e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.411636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92089-0b45-4350-b503-041ac3ec792e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.413292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 330/678] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:06.418235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e64c-4536-414b-8a52-09b2ee0802ab None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.418719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e64c-4536-414b-8a52-09b2ee0802ab None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.419201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889e64c-4536-414b-8a52-09b2ee0802ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.427244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:06.438094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0889e64c-4536-414b-8a52-09b2ee0802ab None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:06.440460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0889e64c-4536-414b-8a52-09b2ee0802ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:06.513080 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 349/679] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:06.592995 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c92089-0b45-4350-b503-041ac3ec792e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:06.645658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e64c-4536-414b-8a52-09b2ee0802ab None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:06.721478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c92089-0b45-4350-b503-041ac3ec792e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:06.758589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:06.759259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.759542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.759817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.760407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:06.761780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:06.765563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889e64c-4536-414b-8a52-09b2ee0802ab None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:06.771190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:06.772218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:06.773141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 331/680] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:06.778095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:06.804709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:06.805351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.805634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.805909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.807903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:06.819836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:06.825494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:06.826588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:06.827635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:06.830414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 350/681] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Oct 19 13:12:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:06.831060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:06.850729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:06.897969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a7e34-8f59-4124-b2cb-26d67db859da None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:06.933258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:06.933971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.934251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.934638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.935296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:06.935601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:06.937091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:06.941401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02778-4319-4386-a038-16af8c06b0ce None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:06.947256 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 332/682] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:06.948577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:06.976060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:06.976621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:06.976925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:06.977198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:06.977884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:06.979260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:06.988611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:06.989543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:06.990440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 351/683] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Oct 19 13:12:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:06.991338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.049114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.052963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fece6c-80bd-4510-80f7-fe6afb60eafa None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.078506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.087719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2e74a-9e76-4bd5-beea-25c6b65d6a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.088332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e74a-9e76-4bd5-beea-25c6b65d6a82 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.088628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e74a-9e76-4bd5-beea-25c6b65d6a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.088886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e74a-9e76-4bd5-beea-25c6b65d6a82 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.089551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2e74a-9e76-4bd5-beea-25c6b65d6a82 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:07.089855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2e74a-9e76-4bd5-beea-25c6b65d6a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.091131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9b096-d05a-4503-a4fb-68484ec461d3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.091293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2e74a-9e76-4bd5-beea-25c6b65d6a82 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.099157 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 333/684] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Oct 19 13:12:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:07.104263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64d8b-0a0d-4333-a73d-7ecb5060408b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.104263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64d8b-0a0d-4333-a73d-7ecb5060408b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.104263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64d8b-0a0d-4333-a73d-7ecb5060408b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.104263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 334/685] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:07.104263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a64d8b-0a0d-4333-a73d-7ecb5060408b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.130079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.130691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.130974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.131275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.131905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:07.132214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.133581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.138244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 352/686] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:07.139008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.207245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a64d8b-0a0d-4333-a73d-7ecb5060408b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.240488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e993491-3489-4b7a-8c06-3a1b1f7ca882 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.240932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786771d-eeb4-4886-b83d-d555ce8f9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.241312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786771d-eeb4-4886-b83d-d555ce8f9924 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.241591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786771d-eeb4-4886-b83d-d555ce8f9924 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.241870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786771d-eeb4-4886-b83d-d555ce8f9924 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.242498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786771d-eeb4-4886-b83d-d555ce8f9924 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:07.242811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786771d-eeb4-4886-b83d-d555ce8f9924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.244229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786771d-eeb4-4886-b83d-d555ce8f9924 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.248776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 335/687] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:07.249975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa251c-ceb1-425d-a593-ef4aa113fbe0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.250271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa251c-ceb1-425d-a593-ef4aa113fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.250547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa251c-ceb1-425d-a593-ef4aa113fbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.261973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.268389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-42aa251c-ceb1-425d-a593-ef4aa113fbe0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:07.269594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-42aa251c-ceb1-425d-a593-ef4aa113fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:07.273268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.273891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.274170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.274438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.285609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.287094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:07.301556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:07.302706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:07.303876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:07.303876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:07.303876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:07.303876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 353/688] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:07.303876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.318975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.338975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 336/689] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:07.340230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa251c-ceb1-425d-a593-ef4aa113fbe0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.404295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbd0b8-9ad0-4a1b-b3dd-914da978f117 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.439295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa251c-ceb1-425d-a593-ef4aa113fbe0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.443859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.444469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.444745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.445022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.445715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] RBAC: Adding query filter params (interface=public, service_id=88c2bbe426934c4094b00259f31f2295, region_id=RegionOne) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:07.446020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.447411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.457479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 354/690] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/endpoints?service_id=88c2bbe426934c4094b00259f31f2295&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:07.457479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.478652 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.479354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.479638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.479915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.480535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:07.480840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.482216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.492122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 337/691] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:07.492122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.501976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.543731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.565477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b5b72-178c-4091-84c2-c1f5522bf9f9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.601982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.602586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.602868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.603172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.603801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b074-b09b-4309-ae33-1427b122bf43 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.603904 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:07.604100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.605471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.618094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 355/692] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:07.618792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.641626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.642756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.643035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.643338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.643941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.645342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.663109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 338/693] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:12:07.663109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.724380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.728851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891321f4-fa9a-49ba-83de-5a4f00b3a7fd None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.770547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.771118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.771400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.771674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.772363 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.773790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.774565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2965f-25be-4cc4-9f0e-14c7a7da37ab None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.788000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:07.807127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 356/694] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:12:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:07.807127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.832172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:07.832836 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:07.833121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:07.833396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:07.834000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:07.835485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:07.848598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:07.849697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:07.850550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:07.853282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 339/695] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:07.860387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:07.951861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b36a-93cb-46ff-911d-770f549e5eda None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:07.999581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.001021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.001446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.002395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.008127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976ee54-e44e-4cc0-9d8e-39fa3cf26650 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.012248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.013780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:12:08.028711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:08.029721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:08.030853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 357/696] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:08.038040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:08.055055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.056001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.056464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.056940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.057783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:08.058072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:08.058293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.059816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.066983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 340/697] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:08.072164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:08.117217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:08.159403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025c272-d956-4ea8-8eef-02d8144d80a6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.198910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.199642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.199922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.200190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.201039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:08.201365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.202988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.213184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d28706-0fd4-4bf7-945a-ecdd4eb49e63 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.222903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 358/698] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:08.228603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:08.255121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.255746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.256027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.256296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.256922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:08.257284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.258704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.267232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 341/699] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:08.270343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:08.307326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:08.341315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e4d3-4beb-4578-9ac8-303b566a5b75 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.372476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:08.377193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5e685-daa8-4439-8f14-808186ec7518 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.380518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.381313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.381740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.382159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.422881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.424486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.426366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.427490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.429317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] RBAC: Adding query filter params (interface=public, service_id=65074bf504354e1c823df372ab291666, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:08.429738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.431274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.439983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 342/700] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/endpoints?service_id=65074bf504354e1c823df372ab291666&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:08.445370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:08.470749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.472488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.551155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:08.573762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a0af-dfbf-4c7c-9cb1-34088db62c30 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.594122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 359/701] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:12:08.599980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:08.617961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.618575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.618875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.619159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.620045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.621566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.631157 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 343/702] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:12:08.720041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982ed3-2b03-4e2f-a788-168be1e4b555 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.758746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.759804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.760305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.760833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.772253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.774174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:08.791254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:08.792307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:08.793199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:08.793199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:08.793199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:08.799214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 360/703] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:08.802456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:08.836457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:08.913634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214da4e9-aad7-4b10-ad8b-c90920f8d1bd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:08.949335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:08.950319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:08.950801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:08.951314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:08.952162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:08.952686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:08.954245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:08.971063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 344/704] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:08.973615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:09.000616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:09.078912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a05d-b064-419e-b9bd-4b34f2bbfc7e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:09.114471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:09.115475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:09.115959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:09.116457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:09.123297 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:09.125015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:12:09.136677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:09.137616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:09.138520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:09.145994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 361/705] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:09.147576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:09.245202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:09.260137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589808cc-aa0d-4c52-b5d8-dca219eff8f9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:09.295448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca82907-e1bb-42a4-9bd6-9daaa9a3b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:09.296133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca82907-e1bb-42a4-9bd6-9daaa9a3b2ea None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:09.296413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca82907-e1bb-42a4-9bd6-9daaa9a3b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:09.296683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca82907-e1bb-42a4-9bd6-9daaa9a3b2ea None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:09.297376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca82907-e1bb-42a4-9bd6-9daaa9a3b2ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:09.297737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca82907-e1bb-42a4-9bd6-9daaa9a3b2ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:09.299288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca82907-e1bb-42a4-9bd6-9daaa9a3b2ea None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:09.311376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 345/706] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:09.317796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:09.419548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:09.425293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fe1b5-0809-4eb0-a0a1-45cb84e49ff8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:09.461533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272be11c-ae00-4b05-95c2-e7703cc07081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:09.462145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be11c-ae00-4b05-95c2-e7703cc07081 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:09.462420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be11c-ae00-4b05-95c2-e7703cc07081 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:09.462689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be11c-ae00-4b05-95c2-e7703cc07081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:09.463447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272be11c-ae00-4b05-95c2-e7703cc07081 None admin] RBAC: Adding query filter params (role.id=254a0165ac6d4047a8971107a6d9e9fa, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=e5328d51705c49b2a44c47eabaa89a2b) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:09.463756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272be11c-ae00-4b05-95c2-e7703cc07081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:09.465177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272be11c-ae00-4b05-95c2-e7703cc07081 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:09.471559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 362/707] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:12:09 2022] GET /identity/v3/role_assignments?user.id=e5328d51705c49b2a44c47eabaa89a2b&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=254a0165ac6d4047a8971107a6d9e9fa => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:09.881172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef840d-f4f6-4938-9212-fd3438d5c833 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:09.881575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef840d-f4f6-4938-9212-fd3438d5c833 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:09.881756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef840d-f4f6-4938-9212-fd3438d5c833 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:09.883368 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 346/708] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:09.888523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d478-4936-4f77-a06e-246fbabc4d2e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:09.888816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d478-4936-4f77-a06e-246fbabc4d2e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:09.889096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d478-4936-4f77-a06e-246fbabc4d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:09.907268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0973d478-4936-4f77-a06e-246fbabc4d2e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:09.908513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0973d478-4936-4f77-a06e-246fbabc4d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:09.976558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 363/709] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:10.118212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81224c81-98dc-4e15-b147-4ca6d626d222 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.118595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81224c81-98dc-4e15-b147-4ca6d626d222 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.118770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81224c81-98dc-4e15-b147-4ca6d626d222 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.120372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 347/710] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:10.125428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab970d-5acf-4632-8c7b-49dc26b34171 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.125720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab970d-5acf-4632-8c7b-49dc26b34171 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.125990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab970d-5acf-4632-8c7b-49dc26b34171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.145176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8dab970d-5acf-4632-8c7b-49dc26b34171 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:10.146277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8dab970d-5acf-4632-8c7b-49dc26b34171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:10.215992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 364/711] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:10.253446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81224c81-98dc-4e15-b147-4ca6d626d222 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:10.360648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81224c81-98dc-4e15-b147-4ca6d626d222 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:10.394955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:10.395672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.395893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.396167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.396753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:10.398170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:10.408576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:10.409649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:10.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 348/712] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:10.416074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab970d-5acf-4632-8c7b-49dc26b34171 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:10.428868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:10.502429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:10.515283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:10.529393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab970d-5acf-4632-8c7b-49dc26b34171 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:10.570376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:10.570990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.571294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.571566 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.572199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:10.572496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:10.574513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:10.580595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 365/713] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:10.588408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:10.623376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc83c4-b49f-43da-badb-d6968f1071da None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:10.664764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:10.671317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:10.672247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.672671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.673588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.674327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:10.676625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:10.688808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:10.690348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:10.691390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:10.697103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 349/714] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:10.699072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:10.709165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902ea7f-08f7-420a-84f4-1d4312c99dff None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:10.750389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:10.751056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.751390 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.751720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.752399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:10.752709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:10.754145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:10.759802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 366/715] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:10.765125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:10.798807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:10.834747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf833f-1c6a-4f0e-937d-8663a8173fb0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:10.881594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:10.882215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.882501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.882778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.883469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:10.884036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:10.886111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:10.887995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02426dbb-7ac1-446b-9560-5990046fc2de None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:10.892099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 350/716] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:12:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:10.898871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:10.933448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c70328-c343-419a-9c4a-b3e99aecab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:10.934507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70328-c343-419a-9c4a-b3e99aecab1d None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:10.934994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70328-c343-419a-9c4a-b3e99aecab1d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:10.935492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c70328-c343-419a-9c4a-b3e99aecab1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:10.936414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c70328-c343-419a-9c4a-b3e99aecab1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:10.938015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c70328-c343-419a-9c4a-b3e99aecab1d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:10.946343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:10.965001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 367/717] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:12:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:11.026909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7d6d-1c68-4579-b866-6e9afdc4b86c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.027267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7d6d-1c68-4579-b866-6e9afdc4b86c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.027509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7d6d-1c68-4579-b866-6e9afdc4b86c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.029169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 368/718] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:12:11.035354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7ab4d-73af-4f40-aa48-fbf8bdbe0e84 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:11.035554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454dbb9-f62a-4aef-beea-ecf881b4b45b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.035636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454dbb9-f62a-4aef-beea-ecf881b4b45b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.035870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454dbb9-f62a-4aef-beea-ecf881b4b45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.055294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1454dbb9-f62a-4aef-beea-ecf881b4b45b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:11.056500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1454dbb9-f62a-4aef-beea-ecf881b4b45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:11.092524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:11.093724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.094292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.094847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.095781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:11.096590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:11.099258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:11.101285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:11.109908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 351/719] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:12:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:11.143956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 369/720] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:11.415804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:11.520056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af57ffd-65f5-48a6-8489-be38d9445f2e None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:11.554788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3be6-e984-463d-94fb-5168b70d879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:11.555446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3be6-e984-463d-94fb-5168b70d879c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.555723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3be6-e984-463d-94fb-5168b70d879c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.555994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3be6-e984-463d-94fb-5168b70d879c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.556573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3be6-e984-463d-94fb-5168b70d879c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:11.557948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3be6-e984-463d-94fb-5168b70d879c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-aa9d3be6-e984-463d-94fb-5168b70d879c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:11.567824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:11.568847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:11.569712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 352/721] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:11.574982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454dbb9-f62a-4aef-beea-ecf881b4b45b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:11.682337 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454dbb9-f62a-4aef-beea-ecf881b4b45b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:11.706744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:11.719072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f2863-1922-475f-8dd2-265b2623e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:11.719894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2863-1922-475f-8dd2-265b2623e700 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.720764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2863-1922-475f-8dd2-265b2623e700 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.721098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2863-1922-475f-8dd2-265b2623e700 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.722935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f2863-1922-475f-8dd2-265b2623e700 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:11.723651 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f2863-1922-475f-8dd2-265b2623e700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:11.725057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f2863-1922-475f-8dd2-265b2623e700 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:11.732002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 370/722] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:11.732259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7996b20-0999-4568-81ba-a8b207976a32 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.732436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7996b20-0999-4568-81ba-a8b207976a32 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.732597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7996b20-0999-4568-81ba-a8b207976a32 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.734093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 353/723] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:11.739326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7996b20-0999-4568-81ba-a8b207976a32 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:11.739795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a083a5-fee2-4420-a51d-a86d0facdf0a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.740086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a083a5-fee2-4420-a51d-a86d0facdf0a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.740367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a083a5-fee2-4420-a51d-a86d0facdf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.758787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f2a083a5-fee2-4420-a51d-a86d0facdf0a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:11.760017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f2a083a5-fee2-4420-a51d-a86d0facdf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:11.819187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:11.846690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 371/724] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:11.864725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7996b20-0999-4568-81ba-a8b207976a32 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:11.900325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:11.901272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:11.901752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:11.902252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:11.903110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:11.903612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:11.905176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:11.910626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 354/725] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Oct 19 13:12:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:11.916434 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a083a5-fee2-4420-a51d-a86d0facdf0a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:12.020484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a083a5-fee2-4420-a51d-a86d0facdf0a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:12.039571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:12.057986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:12.058609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:12.058886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:12.059178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:12.059855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:12.061220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:12.085961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 372/726] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:12:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:12.143598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:12.255598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1539dc6-5f6f-4364-a5c0-3120f9bb91dc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:12.282448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:12.297868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:12.299032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:12.299333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:12.299598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:12.300180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:12.301537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:12.310464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:12.311710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:12.312576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 355/727] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Oct 19 13:12:12 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:12.318594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:12.428570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a44f8-15cc-4ff3-a511-5b64b7c7ef3c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:12.464445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60762d3a-1057-4cd2-9a88-02a10506b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:12.465062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60762d3a-1057-4cd2-9a88-02a10506b429 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:12.465401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60762d3a-1057-4cd2-9a88-02a10506b429 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:12.465677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60762d3a-1057-4cd2-9a88-02a10506b429 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:12.466315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60762d3a-1057-4cd2-9a88-02a10506b429 None admin] RBAC: Adding query filter params (name=image) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:12.466618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60762d3a-1057-4cd2-9a88-02a10506b429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:12.468025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60762d3a-1057-4cd2-9a88-02a10506b429 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:12.478252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 373/728] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:12.479609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:12.582998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576862c-aedc-43bd-9b7b-f450769906e4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:12.618848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08139be3-77d6-42df-a066-7c1ddd8cfa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:12.619793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139be3-77d6-42df-a066-7c1ddd8cfa99 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:12.620283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139be3-77d6-42df-a066-7c1ddd8cfa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:12.620762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139be3-77d6-42df-a066-7c1ddd8cfa99 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:12.621595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08139be3-77d6-42df-a066-7c1ddd8cfa99 None admin] RBAC: Adding query filter params (type=image) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:12.622126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08139be3-77d6-42df-a066-7c1ddd8cfa99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:12.623743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08139be3-77d6-42df-a066-7c1ddd8cfa99 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:12.629052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 356/729] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:13.302767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a201ae-a45f-40b8-ac14-924e082830de None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:13.303342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a201ae-a45f-40b8-ac14-924e082830de None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:13.303342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a201ae-a45f-40b8-ac14-924e082830de None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:13.304929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 374/730] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:13.310232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a508f1-eb06-482f-9264-e13f264a4ce0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:13.310748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a508f1-eb06-482f-9264-e13f264a4ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:13.311282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a508f1-eb06-482f-9264-e13f264a4ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:13.331426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-86a508f1-eb06-482f-9264-e13f264a4ce0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:13.332993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-86a508f1-eb06-482f-9264-e13f264a4ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:13.339257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a96b-9de2-4c49-b563-dec6e2961b17 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:13.339542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a96b-9de2-4c49-b563-dec6e2961b17 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:13.339816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a96b-9de2-4c49-b563-dec6e2961b17 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:13.341394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 375/731] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:12:13.346432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0e0a-b390-4b6e-b05a-e4525aa01474 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:13.346716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0e0a-b390-4b6e-b05a-e4525aa01474 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:13.346996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0e0a-b390-4b6e-b05a-e4525aa01474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:13.365726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e5fb0e0a-b390-4b6e-b05a-e4525aa01474 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:13.367127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e5fb0e0a-b390-4b6e-b05a-e4525aa01474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:13.385246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:13.406872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:13.410649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 357/732] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:13.449630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 376/733] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:13.679300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a508f1-eb06-482f-9264-e13f264a4ce0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:13.727732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb0e0a-b390-4b6e-b05a-e4525aa01474 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:13.803482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a508f1-eb06-482f-9264-e13f264a4ce0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:13.847243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:13.847889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:13.848171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:13.848446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:13.849369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:13.851025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:13.852386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb0e0a-b390-4b6e-b05a-e4525aa01474 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:13.861752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:13.862804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:13.863721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:13.868328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 358/734] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:13.869653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:13.902657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:13.904234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:13.904676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:13.905103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:13.906114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:13.908811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:13.923239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:13.935202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 377/735] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:12:13 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:12:13.997558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e348d5-a930-409d-ab0f-ae7f874542a4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:14.043899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:14.044905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.045400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.045879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.046714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:14.047255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:14.048975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:14.054959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 359/736] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:14.065255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:14.095557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:14.186485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1083fd-b6cf-41a2-b0e2-9a99e74743e1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:14.222587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99449d1-33f6-42b7-85b1-6338f76268eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:14.223237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99449d1-33f6-42b7-85b1-6338f76268eb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.223560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99449d1-33f6-42b7-85b1-6338f76268eb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.223839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99449d1-33f6-42b7-85b1-6338f76268eb None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.224473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99449d1-33f6-42b7-85b1-6338f76268eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:14.224773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99449d1-33f6-42b7-85b1-6338f76268eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:14.226141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99449d1-33f6-42b7-85b1-6338f76268eb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:14.231921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 378/737] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:14.237742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:14.345177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f99fe-1256-48b6-b6f7-6bec446a80e4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:14.347982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:14.371501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f16c6-af00-4339-a0b2-cd19f9bdb408 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.372022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f16c6-af00-4339-a0b2-cd19f9bdb408 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.372102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f16c6-af00-4339-a0b2-cd19f9bdb408 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.373785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 379/738] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:14.380048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75243cc-1488-451d-8085-ba085b7a2eaf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.380444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75243cc-1488-451d-8085-ba085b7a2eaf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.380727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75243cc-1488-451d-8085-ba085b7a2eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.388002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:14.389868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.390364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.390866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.391880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] RBAC: Adding query filter params (interface=admin, service_id=88c2bbe426934c4094b00259f31f2295, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:14.392436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:14.394014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:14.400757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 360/739] 10.222.0.46 () {56 vars in 1249 bytes} [Wed Oct 19 13:12:14 2022] GET /identity/v3/endpoints?service_id=88c2bbe426934c4094b00259f31f2295&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:14.405719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f75243cc-1488-451d-8085-ba085b7a2eaf None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:14.405719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f75243cc-1488-451d-8085-ba085b7a2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:14.407751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:14.483575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 380/740] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:14.530913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e31eb-9d6f-4315-8068-785d22531c19 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:14.567617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb4fa6-3aa3-4b99-ab6c-c60b115dd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:14.568596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb4fa6-3aa3-4b99-ab6c-c60b115dd523 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.569081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb4fa6-3aa3-4b99-ab6c-c60b115dd523 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.569558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb4fa6-3aa3-4b99-ab6c-c60b115dd523 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.570365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb4fa6-3aa3-4b99-ab6c-c60b115dd523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:14.572069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb4fa6-3aa3-4b99-ab6c-c60b115dd523 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:14.579000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 361/741] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:12:14 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:12:14.759458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75243cc-1488-451d-8085-ba085b7a2eaf None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:14.784421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:14.833384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6792609-08bb-41ff-90c7-67d5092a7aa8 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.833941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6792609-08bb-41ff-90c7-67d5092a7aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.833941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6792609-08bb-41ff-90c7-67d5092a7aa8 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.840509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 362/742] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:14.840509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14cef-38f1-4ca3-a14d-a49d35bd29f4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.840802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14cef-38f1-4ca3-a14d-a49d35bd29f4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.841059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14cef-38f1-4ca3-a14d-a49d35bd29f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.874837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75243cc-1488-451d-8085-ba085b7a2eaf None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:14.878887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4cf14cef-38f1-4ca3-a14d-a49d35bd29f4 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:14.880127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4cf14cef-38f1-4ca3-a14d-a49d35bd29f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:14.911392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:14.917045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:14.917671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:14.917952 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:14.918210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:14.918874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:14.920388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:14.922992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING keystone.server.flask.common [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 13:12:14.942553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.sql.core [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 13:12:14.942553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 13:12:14.942553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [parameters: {'id': 'bf950c4db4db4c668e4d477203e0d1d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 13:12:14.942553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf950c4db4db4c668e4d477203e0d1d4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf950c4db4db4c668e4d477203e0d1d4. Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:12:14.951836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 13:12:14.952680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application yield resource Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise self.value Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application session.commit() Oct 19 13:12:14.953667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.session.flush() Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application compat.raise_( Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 13:12:14.954689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 13:12:14.958458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application result.read() Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:12:14.960417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [parameters: {'id': 'bf950c4db4db4c668e4d477203e0d1d4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:14.962568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:14.964541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf950c4db4db4c668e4d477203e0d1d4. Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 381/743] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Oct 19 13:12:14 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:14.967284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:14.977344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 363/744] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:15.048814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:15.073399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8ebe-8c3c-4729-aa7f-ed270d77c469 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:15.108299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:15.108936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:15.109220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:15.109493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:15.117003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:15.118650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:12:15.130578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:15.131542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:15.132448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 382/745] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:15.137432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14cef-38f1-4ca3-a14d-a49d35bd29f4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:15.243879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14cef-38f1-4ca3-a14d-a49d35bd29f4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:15.275428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:15.279694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c971c9f-b1f2-4917-af6b-356d8021c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:15.280314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c971c9f-b1f2-4917-af6b-356d8021c980 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:15.280592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c971c9f-b1f2-4917-af6b-356d8021c980 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:15.280868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c971c9f-b1f2-4917-af6b-356d8021c980 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:15.281529 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c971c9f-b1f2-4917-af6b-356d8021c980 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:15.281831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c971c9f-b1f2-4917-af6b-356d8021c980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:15.283320 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c971c9f-b1f2-4917-af6b-356d8021c980 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:15.307200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 364/746] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:12:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:15.405820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec367-aff7-4b39-b282-883814279a8f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:15.445876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1005e4-9557-4f38-9a6b-0318336164fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:15.446814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1005e4-9557-4f38-9a6b-0318336164fa None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:15.447330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1005e4-9557-4f38-9a6b-0318336164fa None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:15.447800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1005e4-9557-4f38-9a6b-0318336164fa None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:15.448727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1005e4-9557-4f38-9a6b-0318336164fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:15.450297 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1005e4-9557-4f38-9a6b-0318336164fa None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:15.455435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:15.475404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 383/747] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:12:15 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:16.203462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081576fa-67aa-4d22-b0a5-9ba6744bb525 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:16.204403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081576fa-67aa-4d22-b0a5-9ba6744bb525 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:16.204900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081576fa-67aa-4d22-b0a5-9ba6744bb525 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:16.206706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 365/748] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:16.211817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653faa-8c75-4cd4-bea0-97e5600e6774 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:16.212109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653faa-8c75-4cd4-bea0-97e5600e6774 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:16.212391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653faa-8c75-4cd4-bea0-97e5600e6774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:16.244156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d8653faa-8c75-4cd4-bea0-97e5600e6774 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:16.249424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d8653faa-8c75-4cd4-bea0-97e5600e6774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:16.352824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 384/749] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:16.763879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081576fa-67aa-4d22-b0a5-9ba6744bb525 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:16.810515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:16.911291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081576fa-67aa-4d22-b0a5-9ba6744bb525 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:16.913985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419ad7-c941-42be-aa22-b27fcc80c1f6 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:16.914433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419ad7-c941-42be-aa22-b27fcc80c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:16.914596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419ad7-c941-42be-aa22-b27fcc80c1f6 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:16.917194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 385/750] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:12:16.921089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6308-7aea-4ae7-8bad-50b0d9ab1cde None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:16.921377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6308-7aea-4ae7-8bad-50b0d9ab1cde None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:16.921656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6308-7aea-4ae7-8bad-50b0d9ab1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:16.947597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-783a6308-7aea-4ae7-8bad-50b0d9ab1cde None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:16.948960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-783a6308-7aea-4ae7-8bad-50b0d9ab1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:16.950260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:16.950891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:16.951197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:16.951471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:16.952172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:16.953500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:16.962930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:16.963958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:16.964799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 366/751] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:16.969851 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.039288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 386/752] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:16 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:17.069850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:17.085348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a363-0afa-4555-94f6-ad0bf7f23355 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:17.120021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:17.120623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.120899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.121169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.121791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:17.122089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:17.123484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:17.129319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 367/753] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:12:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:17.134979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a6308-7aea-4ae7-8bad-50b0d9ab1cde None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.190688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:17.253112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a6308-7aea-4ae7-8bad-50b0d9ab1cde None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:17.291015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:17.291591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.291877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.292158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.292802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:17.293108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:17.294485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:17.299990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 387/754] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:12:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:17.305703 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.310637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.422400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a9696-7ee9-4e8d-b981-1bfd820106fd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:17.448978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2e52-c13d-4007-9a80-db4772408fb8 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:17.466885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:17.469033 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:17.469649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.469937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.470230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.470943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] RBAC: Adding query filter params (interface=public, service_id=9ec0cabbdab84f1ead5ce1b23bb3e506, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:17.471416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:17.474359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:17.481959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 368/755] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:12:17 2022] GET /identity/v3/endpoints?service_id=9ec0cabbdab84f1ead5ce1b23bb3e506&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:17.488379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.493371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:17.494269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.494798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.495358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.496221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:17.498376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:17.505503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:17.513044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:17.514087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 19 13:12:17.514946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:17.518944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 388/756] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Oct 19 13:12:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:17.522618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.606647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16fa30-5465-4bf1-a9f0-b6d84ba02dea None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:17.631747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002946a-dfc8-43a7-b80f-c961dd274553 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:17.644057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871ae8f-7c67-41f4-8b01-9e1f3bdf0ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:17.644989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871ae8f-7c67-41f4-8b01-9e1f3bdf0ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.645501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871ae8f-7c67-41f4-8b01-9e1f3bdf0ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.645979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871ae8f-7c67-41f4-8b01-9e1f3bdf0ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.646770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871ae8f-7c67-41f4-8b01-9e1f3bdf0ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:17.648349 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871ae8f-7c67-41f4-8b01-9e1f3bdf0ca4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:17.655296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 369/757] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:12:17 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:12:17.656814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1572b9-22b7-4005-9663-97def9e6bbfb None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.657108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1572b9-22b7-4005-9663-97def9e6bbfb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.657385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1572b9-22b7-4005-9663-97def9e6bbfb None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.658810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 370/758] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:17.664846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7f7c-ca91-49b2-95de-e60f1c1cf28d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.665463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7f7c-ca91-49b2-95de-e60f1c1cf28d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.665963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7f7c-ca91-49b2-95de-e60f1c1cf28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.677248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:17.678003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.678357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.678718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.679585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:17.680027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:17.681627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:17.693508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 389/759] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:17.693709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1eaa7f7c-ca91-49b2-95de-e60f1c1cf28d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:17.693966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1eaa7f7c-ca91-49b2-95de-e60f1c1cf28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:17.696247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.757212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:17.799654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 371/760] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:17.801400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20beffe-a9fc-40c1-aaaf-3b94fbb055e6 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.801693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20beffe-a9fc-40c1-aaaf-3b94fbb055e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.801970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20beffe-a9fc-40c1-aaaf-3b94fbb055e6 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.803449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 372/761] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:17.809495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9a99-f7fd-447b-8c57-8d0d0c48e541 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.809793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9a99-f7fd-447b-8c57-8d0d0c48e541 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.810209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9a99-f7fd-447b-8c57-8d0d0c48e541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.833311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f0bb9a99-f7fd-447b-8c57-8d0d0c48e541 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:17.833631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326e4d-f533-4839-a1af-68b084b41581 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:17.834572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f0bb9a99-f7fd-447b-8c57-8d0d0c48e541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:17.836974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:17.871780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:17.872612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:17.873171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:17.873474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:17.874089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:17.874395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:17.876407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:17.882948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 390/762] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Oct 19 13:12:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:17.888758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:17.920157 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 373/763] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:17.998187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f1ce-1045-4028-9709-0f7c43068333 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:18.008553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:18.034486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:18.035177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:18.035464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:18.035789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:18.036472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:18.037851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:18.056386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 391/764] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:12:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:18.075928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9a99-f7fd-447b-8c57-8d0d0c48e541 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:18.202095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9a99-f7fd-447b-8c57-8d0d0c48e541 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:18.216492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:18.252498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:18.253172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:18.253459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:18.253753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:18.254377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:18.255989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:18.258759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING keystone.server.flask.common [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 19 13:12:18.266219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:18.272526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.sql.core [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 13:12:18.272526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 13:12:18.272526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [parameters: {'user_id': '2706018446d140b887f281fbf773455f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 13:12:18.272526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81347) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 19 13:12:18.288888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:12:18.289859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application yield resource Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise self.value Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application session.commit() Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 13:12:18.290987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.flush() Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application compat.raise_( Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 13:12:18.292164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:12:18.293044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:12:18.293913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [parameters: {'user_id': '2706018446d140b887f281fbf773455f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:18.295110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 19 13:12:18.296000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 19 13:12:18.297134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 19 13:12:18.297134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 19 13:12:18.297134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 13:12:18.297134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 13:12:18.297134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 19 13:12:18.297134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:18.297134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 374/765] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Oct 19 13:12:18 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:18.300547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:18.365506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ca47-cb8a-46ce-8cc5-03dc1a274580 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:18.409011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:18.409742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:18.410024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:18.410390 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:18.410978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:18.412399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:18.413538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c0b6b-91fa-4e86-b3a4-e44c79bd5309 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:18.423839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:18.424869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:18.425717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:18.427319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 392/766] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Oct 19 13:12:18 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:18.431677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:18.452810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:18.453525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:18.453875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:18.454222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:18.462674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:18.464483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:18.469118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:12:18.477319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:18.478313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:18.479323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 375/767] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:12:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:18.484236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:18.551481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435d9e8-8659-4fa8-b3c4-8649569461b3 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:18.569579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:18.600203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:18.601273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:18.601783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:18.602546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:18.603913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:18.604690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:18.606488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:18.618496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 393/768] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:18.619125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:18.632569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8812c-c249-48bf-9a24-57adbeb8c066 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:18.679972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:18.681496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:18.682021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:18.682816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:18.684010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:18.684933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:18.687125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:18.729096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 376/769] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Oct 19 13:12:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:18.730980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:18.744911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa957e8-6f30-4495-bc41-65867658cda9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:18.785564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:18.786612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:18.787131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:18.787645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:18.788518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] RBAC: Adding query filter params (type=image) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:18.789092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:18.790812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:18.797388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 394/770] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:18.803910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:19.037364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462ffbc-c2f7-4bf4-8837-b0b7b0ab94b9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:19.053245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:19.074110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274696f6-3682-4654-b051-91b53951f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:19.074723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274696f6-3682-4654-b051-91b53951f167 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:19.075000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274696f6-3682-4654-b051-91b53951f167 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:19.075295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274696f6-3682-4654-b051-91b53951f167 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:19.075996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274696f6-3682-4654-b051-91b53951f167 None admin] RBAC: Adding query filter params (interface=public, service_id=dbe2a2788ddb4b40a07eeec55ae3c3fc, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:19.076306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274696f6-3682-4654-b051-91b53951f167 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:19.077687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274696f6-3682-4654-b051-91b53951f167 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:19.083504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 377/771] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:12:18 2022] GET /identity/v3/endpoints?service_id=dbe2a2788ddb4b40a07eeec55ae3c3fc&interface=public®ion_id=RegionOne => generated 194 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:19.088987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:19.193588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9ebc-073f-4e39-8b91-a3b22e65e401 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:19.227527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb4eeb-18f5-4142-873d-49d2eb52aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:19.228124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4eeb-18f5-4142-873d-49d2eb52aace None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:19.228400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4eeb-18f5-4142-873d-49d2eb52aace None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:19.228668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4eeb-18f5-4142-873d-49d2eb52aace None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:19.229266 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb4eeb-18f5-4142-873d-49d2eb52aace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:19.230617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb4eeb-18f5-4142-873d-49d2eb52aace None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:19.237270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 395/772] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:12:19 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:12:19.952497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6af1-2322-4692-973d-a01c82fddf4f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:19.953057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6af1-2322-4692-973d-a01c82fddf4f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:19.953057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6af1-2322-4692-973d-a01c82fddf4f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:19.954535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 378/773] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:19.960274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972f4ce-6b3c-44f1-a4bf-5adc42e50a6c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:19.960567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972f4ce-6b3c-44f1-a4bf-5adc42e50a6c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:19.960853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972f4ce-6b3c-44f1-a4bf-5adc42e50a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:19.978699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e972f4ce-6b3c-44f1-a4bf-5adc42e50a6c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:19.979917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e972f4ce-6b3c-44f1-a4bf-5adc42e50a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:19.998125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:20.049630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 396/774] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:19 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:20.313480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5befd-1457-482e-921e-c967473e445e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:20.313668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5befd-1457-482e-921e-c967473e445e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:20.314462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5befd-1457-482e-921e-c967473e445e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:20.316153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 379/775] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:20.321401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677ee4-2d4e-4516-8663-45a2db77c6a4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:20.321866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677ee4-2d4e-4516-8663-45a2db77c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:20.322020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b677ee4-2d4e-4516-8663-45a2db77c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:20.322908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5befd-1457-482e-921e-c967473e445e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:20.341974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8b677ee4-2d4e-4516-8663-45a2db77c6a4 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:20.343258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8b677ee4-2d4e-4516-8663-45a2db77c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:20.416509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 397/776] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:20.432265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5befd-1457-482e-921e-c967473e445e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:20.467590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:20.468626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:20.469154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:20.469628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:20.470507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:20.472183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:20.481375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:20.482352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 19 13:12:20.483275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:20.487121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 380/777] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:20.490735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b677ee4-2d4e-4516-8663-45a2db77c6a4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:20.574841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:20.591500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b677ee4-2d4e-4516-8663-45a2db77c6a4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:20.624962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:20.625571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:20.625852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:20.626126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:20.627337 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:20.627643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:20.629011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:20.633956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 398/778] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:12:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:20.639484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:20.684646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:20.686149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:20.746092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1321b6c-1051-4e01-9d02-1d119d2564c6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:20.780283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:20.780897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:20.781174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:20.781449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:20.782079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:20.782389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:20.784317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:20.789098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 381/779] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Oct 19 13:12:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:20.794736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:20.803176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f3f63-ef37-4391-b4a6-0fa964272436 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:20.848473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:20.849109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:20.849388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:20.849660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:20.850799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:20.852264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:20.855115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 399/780] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:20.859949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:20.878929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:20.899898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574a2d3-62d3-42db-bfc3-52af86a21286 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:20.908664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:20.938737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009c815-dc28-4f71-819d-991e9f225c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:20.939409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009c815-dc28-4f71-819d-991e9f225c7a None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:20.939689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009c815-dc28-4f71-819d-991e9f225c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:20.940225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009c815-dc28-4f71-819d-991e9f225c7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:20.940897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009c815-dc28-4f71-819d-991e9f225c7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:20.942273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009c815-dc28-4f71-819d-991e9f225c7a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:20.964169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 382/781] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:12:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:12:20.969736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a2ce-5f0e-4b35-8a2d-b1cc06237739 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:21.016992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369a21e-8f63-421b-8b24-635acb5f1e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:21.017696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369a21e-8f63-421b-8b24-635acb5f1e14 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:21.017950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369a21e-8f63-421b-8b24-635acb5f1e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:21.018226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369a21e-8f63-421b-8b24-635acb5f1e14 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:21.018962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369a21e-8f63-421b-8b24-635acb5f1e14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:21.020495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369a21e-8f63-421b-8b24-635acb5f1e14 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:21.051920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 400/782] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:12:20 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:12:21.379649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e3b5-b27b-4df7-9ab8-3daf62d13861 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:21.380044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e3b5-b27b-4df7-9ab8-3daf62d13861 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:21.380222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e3b5-b27b-4df7-9ab8-3daf62d13861 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:21.381718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 383/783] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:21.386700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92200b-4e49-4e23-9024-fe54e4dee9a1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:21.387257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92200b-4e49-4e23-9024-fe54e4dee9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:21.387257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92200b-4e49-4e23-9024-fe54e4dee9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:21.405631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5a92200b-4e49-4e23-9024-fe54e4dee9a1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:21.406814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5a92200b-4e49-4e23-9024-fe54e4dee9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:21.467820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:21.483150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 401/784] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:21.740350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8e3b5-b27b-4df7-9ab8-3daf62d13861 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:21.845898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8e3b5-b27b-4df7-9ab8-3daf62d13861 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:21.881936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:21.882570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:21.882844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:21.883215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:21.883804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:21.885164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:21.894093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:21.895110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 19 13:12:21.895992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:21.897389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 384/785] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Oct 19 13:12:21 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:21.901172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92200b-4e49-4e23-9024-fe54e4dee9a1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:22.003163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92200b-4e49-4e23-9024-fe54e4dee9a1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:22.036717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:22.037318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:22.037594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:22.037863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:22.038484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] RBAC: Adding query filter params (name=image) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:22.038785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:22.040179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:22.047237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 402/786] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:22.050702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:22.078443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:22.152360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe6d1-1227-412a-80b9-72cdbc3e5fc2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:22.194058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf3e87-4bd1-4c76-8ffa-9afa568dea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:22.194884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3e87-4bd1-4c76-8ffa-9afa568dea0c None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:22.195382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3e87-4bd1-4c76-8ffa-9afa568dea0c None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:22.195829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3e87-4bd1-4c76-8ffa-9afa568dea0c None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:22.196628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf3e87-4bd1-4c76-8ffa-9afa568dea0c None admin] RBAC: Adding query filter params (type=image) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:22.197122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf3e87-4bd1-4c76-8ffa-9afa568dea0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:22.198709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf3e87-4bd1-4c76-8ffa-9afa568dea0c None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:22.203853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 385/787] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:22.210258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:22.270356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:22.312972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297683ac-123c-4b9f-9d5c-6c90bb998346 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:22.349522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b028612-c95d-4c4f-9cec-d0f8984686c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:22.350133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b028612-c95d-4c4f-9cec-d0f8984686c5 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:22.350413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b028612-c95d-4c4f-9cec-d0f8984686c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:22.350682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b028612-c95d-4c4f-9cec-d0f8984686c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:22.351382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b028612-c95d-4c4f-9cec-d0f8984686c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:22.352746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b028612-c95d-4c4f-9cec-d0f8984686c5 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:22.373643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 403/788] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:12:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:23.222828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d6b6-da66-4760-a122-ccc567e80dad None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.223396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d6b6-da66-4760-a122-ccc567e80dad None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.223396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d6b6-da66-4760-a122-ccc567e80dad None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.224911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 386/789] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:23.229755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e899-5fea-46ba-87b4-43db1fa3722a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.230151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e899-5fea-46ba-87b4-43db1fa3722a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.230308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e899-5fea-46ba-87b4-43db1fa3722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.249120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fd59e899-5fea-46ba-87b4-43db1fa3722a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:23.250113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039758-1581-4beb-9037-ca9b47adae6d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.250313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fd59e899-5fea-46ba-87b4-43db1fa3722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:23.250415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039758-1581-4beb-9037-ca9b47adae6d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.250654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039758-1581-4beb-9037-ca9b47adae6d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.252549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 387/790] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:23.257914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c270-37c7-4deb-9909-030f7c807200 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.258215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c270-37c7-4deb-9909-030f7c807200 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.258461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c270-37c7-4deb-9909-030f7c807200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.277765 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-eda1c270-37c7-4deb-9909-030f7c807200 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:23.279326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eda1c270-37c7-4deb-9909-030f7c807200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:23.327274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 404/791] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:23.355116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 388/792] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:23.597342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e899-5fea-46ba-87b4-43db1fa3722a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:23.614396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c270-37c7-4deb-9909-030f7c807200 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:23.636036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:23.641340 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:23.705901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e899-5fea-46ba-87b4-43db1fa3722a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:23.726589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c270-37c7-4deb-9909-030f7c807200 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:23.742080 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:23.742704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.742987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.743299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.754217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:23.759051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:23.760015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:23.760857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 405/793] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Oct 19 13:12:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:23.766045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:23.766828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:23.768268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.768857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.769346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.770847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:23.772437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:23.775120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 389/794] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:23.779492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:23.869025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:23.872855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757089fa-e599-4d56-8bf7-37b1b914920e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:23.875677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:23.891793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9a355-f9aa-433f-bf88-acbb525d797d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:23.914162 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:23.915193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.915699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.916047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.916727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:23.917144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:23.918659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:23.925638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:23.926255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:23.926532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:23.926807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:23.927495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:23.928474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 406/795] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Oct 19 13:12:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:23.928925 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:23.933938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:23.955218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 390/796] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:12:23 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:12:24.049819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16456a7f-2c61-4302-b1eb-8c1478a2394a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:24.086830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:24.087504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.087786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.088062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.099830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:24.101306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:24.119625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:24.120680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:24.121589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:24.121589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:24.121589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:24.121589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 407/797] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:24.127071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:24.240983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d4da2-3c5c-4177-a1e1-0d62ff6be9e1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:24.275718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:24.276379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.276664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.276939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.277586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:24.277890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:24.279293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:24.291344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 391/798] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:24.296930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:24.313617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:24.399601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3b7c6-b23b-4b40-a9a5-645a54525b29 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:24.433828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b689612-5d7d-47ec-90f9-123915841c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:24.434490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689612-5d7d-47ec-90f9-123915841c21 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.434769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689612-5d7d-47ec-90f9-123915841c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.435040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689612-5d7d-47ec-90f9-123915841c21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.444630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b689612-5d7d-47ec-90f9-123915841c21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:24.446106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b689612-5d7d-47ec-90f9-123915841c21 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7b689612-5d7d-47ec-90f9-123915841c21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:12:24.458565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:24.459810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:12:24.460767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:24.463170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 408/799] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Oct 19 13:12:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:24.465901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:24.470000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:24.543139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054f6a-f58b-436d-b919-e609c682ac34 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.543808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054f6a-f58b-436d-b919-e609c682ac34 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.544287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054f6a-f58b-436d-b919-e609c682ac34 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.546105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 409/800] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:24.551819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4d25-55c8-4c7b-b189-e6d28044f5ac None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.552345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4d25-55c8-4c7b-b189-e6d28044f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.553097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4d25-55c8-4c7b-b189-e6d28044f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.575569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8841343-0f53-47c8-856c-1010b0478269 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:24.577719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a5da4d25-55c8-4c7b-b189-e6d28044f5ac None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:24.580095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a5da4d25-55c8-4c7b-b189-e6d28044f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:24.611495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:24.612103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.612383 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.612660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.613390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:24.613701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:24.615171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:24.632883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 392/801] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Oct 19 13:12:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:24.638589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:24.660344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 410/802] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:24.703445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:24.744184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53d87-d80a-424c-8e1d-15b7a91dc921 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:24.778365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:24.778991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.779294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.779572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.790281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:24.791749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:24.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:24.807684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:24.813565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:24.813565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:24.813565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:24.813565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 393/803] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:24.815378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4d25-55c8-4c7b-b189-e6d28044f5ac None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:24.819010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:24.919384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4d25-55c8-4c7b-b189-e6d28044f5ac None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:24.924585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:24.957888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:24.958508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:24.958792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:24.959073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:24.959728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:24.960038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:24.961408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:24.974749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 411/804] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:24.980019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:25.041665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:25.047473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad118a-6291-4068-b1bc-b3908c586698 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:25.062669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:25.082647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7cd1b-ee6f-4419-85de-9111b8ed94cb None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:25.086341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:25.086959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:25.087285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:25.087562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:25.088251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:25.090069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:25.099971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.sql.core [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 13:12:25.099971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 13:12:25.099971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [parameters: {'id': '6278d958066f4dd493edb5c29e426194', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 13:12:25.099971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81347) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:12:25.107244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 19 13:12:25.108059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application yield resource Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application next(self.gen) Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.rollback() Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.force_reraise() Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise self.value Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application session.commit() Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 19 13:12:25.109098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._prepare_impl() Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.session.flush() Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._flush(objects) Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application compat.raise_( Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application flush_context.execute() Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rec.execute(self) Oct 19 13:12:25.110385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 13:12:25.111989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result = self._query(query) Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application conn.query(q) Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application result.read() Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 19 13:12:25.113200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [parameters: {'id': '6278d958066f4dd493edb5c29e426194', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 19 13:12:25.116070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:25.119341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 394/805] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Oct 19 13:12:24 2022] POST /identity/v3/domains => generated 190 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:25.122014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:25.124053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:25.124053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:25.124053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:25.125153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:25.133453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:25.135290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:12:25.147980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:25.148956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:25.149905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 412/806] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:25.154783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:25.235636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f62a69-ae5b-4947-84b6-6cb409d7f116 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:25.263447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61669f2-d11c-4d5e-af79-3f72dc5ebe6c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:25.271257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:25.272831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:25.273113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:25.273390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:25.285070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:25.286535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:25.288776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:25.300454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:25.301173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:25.301452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:25.301634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:25.302595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:25.303530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:25.303530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:25.303530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:25.304183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:25.304183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:25.304183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:25.304183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:25.307823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 395/807] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:25.308446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:25.318395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 413/808] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:25.324024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:25.345270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:25.419704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dbdb7-ea65-4647-8bd4-d518361895bc None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:25.433161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2405bd-0030-48bb-84ad-417f956182d1 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:25.455541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a75b45-1d27-4b0a-90a7-a0c3fd1343df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:25.456088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75b45-1d27-4b0a-90a7-a0c3fd1343df None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:25.456370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75b45-1d27-4b0a-90a7-a0c3fd1343df None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:25.456648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75b45-1d27-4b0a-90a7-a0c3fd1343df None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:25.457316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a75b45-1d27-4b0a-90a7-a0c3fd1343df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:25.457626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a75b45-1d27-4b0a-90a7-a0c3fd1343df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:25.459044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a75b45-1d27-4b0a-90a7-a0c3fd1343df None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:25.477152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 396/809] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:25.588304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf8f8d-50dd-4ae5-a664-c0c52f9d03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:25.588980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf8f8d-50dd-4ae5-a664-c0c52f9d03ac None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:25.589256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf8f8d-50dd-4ae5-a664-c0c52f9d03ac None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:25.589522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf8f8d-50dd-4ae5-a664-c0c52f9d03ac None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1433a2c778346a09a10845139967c27/roles/254a0165ac6d4047a8971107a6d9e9fa` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:25.591694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf8f8d-50dd-4ae5-a664-c0c52f9d03ac None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=c1433a2c778346a09a10845139967c27, role_id=254a0165ac6d4047a8971107a6d9e9fa)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:25.593127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf8f8d-50dd-4ae5-a664-c0c52f9d03ac None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:25.609169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 414/810] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:12:25 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1433a2c778346a09a10845139967c27/roles/254a0165ac6d4047a8971107a6d9e9fa => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:12:26.177712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3708-d727-409e-8e39-abc487bc027f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:26.178104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3708-d727-409e-8e39-abc487bc027f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:26.178458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3708-d727-409e-8e39-abc487bc027f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:26.180243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 397/811] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:26.185133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab522f90-905f-4e79-8a42-26bfe6b2e4ee None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:26.185425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab522f90-905f-4e79-8a42-26bfe6b2e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:26.185705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab522f90-905f-4e79-8a42-26bfe6b2e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:26.203588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ab522f90-905f-4e79-8a42-26bfe6b2e4ee None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:26.204797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ab522f90-905f-4e79-8a42-26bfe6b2e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:26.244104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:26.270859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 415/812] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:26.536566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec3708-d727-409e-8e39-abc487bc027f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:26.625581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:26.636792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec3708-d727-409e-8e39-abc487bc027f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:26.670555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:26.671202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:26.671481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:26.671752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:26.681890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:26.686632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:26.687781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:26.688740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 398/813] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:26.694551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab522f90-905f-4e79-8a42-26bfe6b2e4ee None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:26.790319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab522f90-905f-4e79-8a42-26bfe6b2e4ee None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:26.823816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:26.824418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:26.824692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:26.824957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:26.825612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:26.825908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:26.827300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:26.835779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 416/814] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:26.841577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:26.938537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79905f32-99a0-4135-92a7-3692458b28a8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:26.972636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:26.973265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:26.973548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:26.973825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] PATH_INFO: `/v3/users/fdddb23c6d5f494fa0ee42100ba3bd2f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:26.987266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] RBAC: Authorizing `identity:get_user(user_id=fdddb23c6d5f494fa0ee42100ba3bd2f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:26.988709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:26.990298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 399/815] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:26 2022] GET /identity/v3/users/fdddb23c6d5f494fa0ee42100ba3bd2f => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:26.996091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:27.030939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:27.094217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af1d6c-a394-4870-b0d6-230f10931cf9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:27.127622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32fe9-7ad6-4eca-9b99-ca5e7937729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:27.128249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32fe9-7ad6-4eca-9b99-ca5e7937729a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:27.128530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32fe9-7ad6-4eca-9b99-ca5e7937729a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:27.128802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32fe9-7ad6-4eca-9b99-ca5e7937729a None admin] PATH_INFO: `/v3/projects/64ab4b385c114cf2abce492172b66b1b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:27.129919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e32fe9-7ad6-4eca-9b99-ca5e7937729a None admin] RBAC: Authorizing `identity:get_project(project_id=64ab4b385c114cf2abce492172b66b1b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:27.131370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e32fe9-7ad6-4eca-9b99-ca5e7937729a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:27.132979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 417/816] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:12:26 2022] GET /identity/v3/projects/64ab4b385c114cf2abce492172b66b1b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:27.138992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:27.149659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:27.242687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba179a2d-b96b-43fc-ba3f-2ed831bed153 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:27.276237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa62c5-c73d-4fd5-9a1f-709be7f7d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:27.276893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa62c5-c73d-4fd5-9a1f-709be7f7d6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:27.277175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa62c5-c73d-4fd5-9a1f-709be7f7d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:27.277453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa62c5-c73d-4fd5-9a1f-709be7f7d6a6 None admin] PATH_INFO: `/v3/projects/64ab4b385c114cf2abce492172b66b1b/users/fdddb23c6d5f494fa0ee42100ba3bd2f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:27.279384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa62c5-c73d-4fd5-9a1f-709be7f7d6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=64ab4b385c114cf2abce492172b66b1b, user_id=fdddb23c6d5f494fa0ee42100ba3bd2f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:27.280822 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa62c5-c73d-4fd5-9a1f-709be7f7d6a6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:27.293954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 400/817] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:12:27 2022] PUT /identity/v3/projects/64ab4b385c114cf2abce492172b66b1b/users/fdddb23c6d5f494fa0ee42100ba3bd2f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:12:27.741611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e371-3f31-4d0d-861d-483fdc2112fe None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:27.742169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e371-3f31-4d0d-861d-483fdc2112fe None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:27.742169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e371-3f31-4d0d-861d-483fdc2112fe None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:27.743524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 418/818] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:27.748887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bd7e4-a043-4dd8-bee9-fdf2e0912b5e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:27.749285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bd7e4-a043-4dd8-bee9-fdf2e0912b5e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:27.749436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bd7e4-a043-4dd8-bee9-fdf2e0912b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:27.768212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8c4bd7e4-a043-4dd8-bee9-fdf2e0912b5e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:27.769380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8c4bd7e4-a043-4dd8-bee9-fdf2e0912b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:27.828552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:27.835003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 401/819] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:28.104987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e371-3f31-4d0d-861d-483fdc2112fe None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:28.207890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e371-3f31-4d0d-861d-483fdc2112fe None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:28.210157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:28.241868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:28.242493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:28.242771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:28.243040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:28.252702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:28.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:28.258533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:28.259419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 419/820] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Oct 19 13:12:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:28.264567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bd7e4-a043-4dd8-bee9-fdf2e0912b5e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:28.360630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bd7e4-a043-4dd8-bee9-fdf2e0912b5e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:28.393447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:28.394048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:28.394326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:28.394596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:28.395292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:28.395598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:28.396964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:28.404709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 402/821] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Oct 19 13:12:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:28.411530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:28.506429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d8b69-f917-43cc-81c6-aae8a07960bb None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:28.539403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:28.540031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:28.540310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:28.540579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:28.550678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:28.552141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:28.566308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:28.567467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:28.568585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:28.568585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:28.568585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:28.571237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 420/822] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:28.573223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:28.631850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:28.674270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0164-5319-43ff-98de-2b82292f1ca0 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:28.707835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:28.708438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:28.708724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:28.708999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:28.709640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:28.709948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:28.711345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:28.723576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 403/823] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:28.729145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:28.746958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:28.829098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93836c5-a88f-401a-bd0c-81f8a9543241 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:28.862489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:28.863136 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:28.863420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:28.863699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:28.870849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:28.872314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:12:28.883541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:28.884663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:28.885925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 421/824] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Oct 19 13:12:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:28.890364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:28.988446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8db4c-81cd-453e-a627-bea1be1a8ed3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:29.008962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.023837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:29.024440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.024718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.024988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.025715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:29.026018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:29.027475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:29.045028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 404/825] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Oct 19 13:12:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:29.050784 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:29.124793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.149494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a83aa-e64c-44cb-a70f-3ef482759f1b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:29.184385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816d41-fb08-4616-9a91-c61007d09616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:29.184525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816d41-fb08-4616-9a91-c61007d09616 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.184703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816d41-fb08-4616-9a91-c61007d09616 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.184974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816d41-fb08-4616-9a91-c61007d09616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.249928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49816d41-fb08-4616-9a91-c61007d09616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:29.251935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49816d41-fb08-4616-9a91-c61007d09616 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:29.328064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.352606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 422/826] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:12:29.358351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:29.410989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa69a-83c6-4e4c-b19d-aa59b3662d80 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.411295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa69a-83c6-4e4c-b19d-aa59b3662d80 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.411488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa69a-83c6-4e4c-b19d-aa59b3662d80 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.412833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 423/827] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:12:29.417908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2f5a-86a0-4c7c-b1a6-277184794902 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.418197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2f5a-86a0-4c7c-b1a6-277184794902 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.418476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be2f5a-86a0-4c7c-b1a6-277184794902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.436593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-74be2f5a-86a0-4c7c-b1a6-277184794902 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:29.437933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-74be2f5a-86a0-4c7c-b1a6-277184794902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:29.460104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359b0a-b011-4c57-bc9f-47ac9ed61ee2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:29.495007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:29.495666 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.495950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.496228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.506939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:29.508417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:29.510764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 424/828] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:12:29.523119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:29.524370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:12:29.525371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:12:29.525371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:12:29.525371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:29.525371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 405/829] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:29.529927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be2f5a-86a0-4c7c-b1a6-277184794902 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:29.625523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be2f5a-86a0-4c7c-b1a6-277184794902 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:29.632982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.659169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:29.659775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.660054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.660326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.660969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:29.661320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:29.662633 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:29.673857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 425/830] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:29.679512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:29.709793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.774629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:29.777041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae2710-f5a7-4e6e-8209-1542b568f8ff None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:29.811112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:29.811738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.812016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.812290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.819560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:29.821816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:12:29.833335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:29.834321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:29.835272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 406/831] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:29.840473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:29.872961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64bfc4-5f8b-411c-bffa-da7e20fb64ad None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:29.906973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:29.908231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.908486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.908752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.918831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:29.924034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:29.925071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:29.925933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 426/832] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:12:29.930203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.930988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:29.940903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffdf1-34c4-4f0c-a6a4-32043be910c9 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:29.958076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.974724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:29.975357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:29.975635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:29.975912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:29.976593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:29.976897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:29.978407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:29.990849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 407/833] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:29.996917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:30.032378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d8a4-d4bc-4930-9d8e-9205063eab40 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:30.065438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:30.066043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:30.066322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:30.066592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:30.067336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:30.067641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:30.069003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:30.077275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 427/834] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:30.083620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:30.094555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4103b-5b08-4043-b76e-decb202ca791 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:30.127875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:30.128470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:30.128744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:30.129021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:30.129737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] RBAC: Adding query filter params (role.id=254a0165ac6d4047a8971107a6d9e9fa, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=c1433a2c778346a09a10845139967c27) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:30.130044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:30.131556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:30.137096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 408/835] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:12:29 2022] GET /identity/v3/role_assignments?user.id=c1433a2c778346a09a10845139967c27&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=254a0165ac6d4047a8971107a6d9e9fa => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:30.176286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:30.193096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15468591-2a7c-4963-a851-5359e360eb3c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:30.229556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:30.230211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:30.230489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:30.230804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] PATH_INFO: `/v3/users/fdddb23c6d5f494fa0ee42100ba3bd2f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:30.232030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] RBAC: Authorizing `identity:get_user(user_id=fdddb23c6d5f494fa0ee42100ba3bd2f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:30.233473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:30.235117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 428/836] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:30 2022] GET /identity/v3/users/fdddb23c6d5f494fa0ee42100ba3bd2f => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:12:30.240991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:30.258380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:30.347145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e549-5e25-4bcc-8ca7-719a6ef29a78 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:30.380987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:30.381610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:30.381884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:30.382152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:30.450834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:30.452253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:30.467261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:30.551801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 409/837] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:12:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:12:30.557695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:30.655933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9d21d-d8d9-45a6-ab19-fda35f8cca03 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:30.688602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636a9e2-bc94-4d17-bc50-395026752e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:30.689838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636a9e2-bc94-4d17-bc50-395026752e7c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:30.690369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636a9e2-bc94-4d17-bc50-395026752e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:30.690641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636a9e2-bc94-4d17-bc50-395026752e7c None admin] PATH_INFO: `/v3/projects/64ab4b385c114cf2abce492172b66b1b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:30.691808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636a9e2-bc94-4d17-bc50-395026752e7c None admin] RBAC: Authorizing `identity:get_project(project_id=64ab4b385c114cf2abce492172b66b1b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:30.693234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636a9e2-bc94-4d17-bc50-395026752e7c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:30.694856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 429/838] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:12:30 2022] GET /identity/v3/projects/64ab4b385c114cf2abce492172b66b1b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:30.701096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:30.802308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363870b-1397-4846-965c-0f841c9d7a12 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:30.817071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:30.838182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0940881-8177-4156-8bf5-ee958afebc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:30.838789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0940881-8177-4156-8bf5-ee958afebc23 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:30.839065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0940881-8177-4156-8bf5-ee958afebc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:30.839363 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0940881-8177-4156-8bf5-ee958afebc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:30.840083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0940881-8177-4156-8bf5-ee958afebc23 None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=64ab4b385c114cf2abce492172b66b1b, user.id=fdddb23c6d5f494fa0ee42100ba3bd2f) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:30.840388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0940881-8177-4156-8bf5-ee958afebc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:30.841816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0940881-8177-4156-8bf5-ee958afebc23 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:30.848016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 410/839] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:12:30 2022] GET /identity/v3/role_assignments?user.id=fdddb23c6d5f494fa0ee42100ba3bd2f&scope.project.id=64ab4b385c114cf2abce492172b66b1b&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:32.984457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06066-fbf4-4a66-8e51-2163ca8df269 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:32.985010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06066-fbf4-4a66-8e51-2163ca8df269 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:32.985010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06066-fbf4-4a66-8e51-2163ca8df269 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:32.986967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 430/840] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:32.992240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995fb8-d6b4-4373-93df-b7e1587e1b7d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:32.992659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995fb8-d6b4-4373-93df-b7e1587e1b7d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:32.992793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995fb8-d6b4-4373-93df-b7e1587e1b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:33.010399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-05995fb8-d6b4-4373-93df-b7e1587e1b7d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:33.011617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-05995fb8-d6b4-4373-93df-b7e1587e1b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:33.076769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 411/841] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:33.346100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb06066-fbf4-4a66-8e51-2163ca8df269 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:33.370494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:33.444912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb06066-fbf4-4a66-8e51-2163ca8df269 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:33.477073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abe9b5-b92f-4cc6-a696-2497f720bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:33.477682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe9b5-b92f-4cc6-a696-2497f720bb9e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:33.477961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe9b5-b92f-4cc6-a696-2497f720bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:33.478236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abe9b5-b92f-4cc6-a696-2497f720bb9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:33.479370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe9b5-b92f-4cc6-a696-2497f720bb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:33.480789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abe9b5-b92f-4cc6-a696-2497f720bb9e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:33.482325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 431/842] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:33.488049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995fb8-d6b4-4373-93df-b7e1587e1b7d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:33.583343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995fb8-d6b4-4373-93df-b7e1587e1b7d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:33.592131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:33.616732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f4e5-9ce5-492a-b1bc-3e4428832d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:33.617260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f4e5-9ce5-492a-b1bc-3e4428832d8d None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:33.617537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f4e5-9ce5-492a-b1bc-3e4428832d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:33.617806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f4e5-9ce5-492a-b1bc-3e4428832d8d None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:33.618457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9f4e5-9ce5-492a-b1bc-3e4428832d8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:33.619912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9f4e5-9ce5-492a-b1bc-3e4428832d8d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:33.641017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 412/843] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:12:33 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:35.775607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e307db7-efe1-482a-a950-6f09cae4929d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:35.776170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e307db7-efe1-482a-a950-6f09cae4929d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:35.776170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e307db7-efe1-482a-a950-6f09cae4929d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:35.777499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 432/844] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:35.783308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d909d4-d8b5-44b0-8387-54d1ff5437ff None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:35.783707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d909d4-d8b5-44b0-8387-54d1ff5437ff None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:35.783894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d909d4-d8b5-44b0-8387-54d1ff5437ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:35.802319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b6d909d4-d8b5-44b0-8387-54d1ff5437ff None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:35.803524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b6d909d4-d8b5-44b0-8387-54d1ff5437ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:35.868974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 413/845] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:36.136687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e307db7-efe1-482a-a950-6f09cae4929d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:36.226468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:36.236220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e307db7-efe1-482a-a950-6f09cae4929d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:36.268556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:36.269172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:36.269452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:36.269726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] PATH_INFO: `/v3/roles/c2a5de5e2b0745e89cd777db9a2d1099` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:36.271125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] RBAC: Authorizing `identity:get_role(role_id=c2a5de5e2b0745e89cd777db9a2d1099)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:36.272493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:36.273794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 433/846] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:36 2022] GET /identity/v3/roles/c2a5de5e2b0745e89cd777db9a2d1099 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:36.279567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d909d4-d8b5-44b0-8387-54d1ff5437ff None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:36.368317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:36.375777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d909d4-d8b5-44b0-8387-54d1ff5437ff None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:36.409422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:36.409987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:36.410268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:36.410542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] PATH_INFO: `/v3/users/6b8cd7aa97254a37bf619d364b3fc169` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:36.422989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] RBAC: Authorizing `identity:get_user(user_id=6b8cd7aa97254a37bf619d364b3fc169)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:36.424458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:36.426061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 414/847] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:36 2022] GET /identity/v3/users/6b8cd7aa97254a37bf619d364b3fc169 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:36.431649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:36.526758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871e72-34db-4a65-8f4d-fe7d49a5088a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:36.559631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9858c-2c3c-4025-8bd6-b4509409395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:36.560244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9858c-2c3c-4025-8bd6-b4509409395a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:36.560523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9858c-2c3c-4025-8bd6-b4509409395a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:36.560796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9858c-2c3c-4025-8bd6-b4509409395a None admin] PATH_INFO: `/v3/projects/64ab4b385c114cf2abce492172b66b1b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:36.561901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9858c-2c3c-4025-8bd6-b4509409395a None admin] RBAC: Authorizing `identity:get_project(project_id=64ab4b385c114cf2abce492172b66b1b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:36.563360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9858c-2c3c-4025-8bd6-b4509409395a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:36.565237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 434/848] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:12:36 2022] GET /identity/v3/projects/64ab4b385c114cf2abce492172b66b1b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:36.570883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:36.666029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8236e1a-45da-4817-8f64-c0095dad9a40 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:36.698809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6bf00-4d0c-4c89-8fdd-c83bd0ee111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:36.699470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6bf00-4d0c-4c89-8fdd-c83bd0ee111d None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:36.699747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6bf00-4d0c-4c89-8fdd-c83bd0ee111d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:36.700017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6bf00-4d0c-4c89-8fdd-c83bd0ee111d None admin] PATH_INFO: `/v3/projects/64ab4b385c114cf2abce492172b66b1b/users/6b8cd7aa97254a37bf619d364b3fc169/roles/c2a5de5e2b0745e89cd777db9a2d1099` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:36.702141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6bf00-4d0c-4c89-8fdd-c83bd0ee111d None admin] RBAC: Authorizing `identity:create_grant(project_id=64ab4b385c114cf2abce492172b66b1b, user_id=6b8cd7aa97254a37bf619d364b3fc169, role_id=c2a5de5e2b0745e89cd777db9a2d1099)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:36.703588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6bf00-4d0c-4c89-8fdd-c83bd0ee111d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:36.716191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 415/849] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:12:36 2022] PUT /identity/v3/projects/64ab4b385c114cf2abce492172b66b1b/users/6b8cd7aa97254a37bf619d364b3fc169/roles/c2a5de5e2b0745e89cd777db9a2d1099 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:12:38.813086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7483c-c422-44ef-a69c-849af72b2222 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:38.813618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7483c-c422-44ef-a69c-849af72b2222 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:38.813618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7483c-c422-44ef-a69c-849af72b2222 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:38.815780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 435/850] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:38.821353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4827f-8fc5-4d2e-94e0-dd1f24209588 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:38.821828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4827f-8fc5-4d2e-94e0-dd1f24209588 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:38.821980 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4827f-8fc5-4d2e-94e0-dd1f24209588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:38.840622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a6e4827f-8fc5-4d2e-94e0-dd1f24209588 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:38.841812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a6e4827f-8fc5-4d2e-94e0-dd1f24209588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:38.848989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:38.906878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 416/851] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:12:39.172218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7483c-c422-44ef-a69c-849af72b2222 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:39.201032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:39.270495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7483c-c422-44ef-a69c-849af72b2222 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:39.302713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:39.303353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:39.303629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:39.303900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] PATH_INFO: `/v3/roles/c2a5de5e2b0745e89cd777db9a2d1099` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:39.305266 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] RBAC: Authorizing `identity:get_role(role_id=c2a5de5e2b0745e89cd777db9a2d1099)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:39.306616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:39.307929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 436/852] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:39 2022] GET /identity/v3/roles/c2a5de5e2b0745e89cd777db9a2d1099 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:39.313659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4827f-8fc5-4d2e-94e0-dd1f24209588 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:39.409952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4827f-8fc5-4d2e-94e0-dd1f24209588 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:39.442636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:39.443221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:39.443498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:39.443766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] PATH_INFO: `/v3/users/6b8cd7aa97254a37bf619d364b3fc169` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:39.444862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=6b8cd7aa97254a37bf619d364b3fc169)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:39.446287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:39.447854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 417/853] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:39 2022] GET /identity/v3/users/6b8cd7aa97254a37bf619d364b3fc169 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:39.453545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:39.547715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:39.553595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2226d-7395-496a-9631-880fe032a233 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:39.586858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:39.587484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:39.587765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:39.588039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:39.651697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:39.653135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:39.740567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:39.747067 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 437/854] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:12:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:12:39.753667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:39.765809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:39.850143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46ec7-fced-452a-8fd2-528dc589e0d4 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:39.882875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d4273-48ad-40f6-bb27-642e49daab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:39.883517 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d4273-48ad-40f6-bb27-642e49daab5e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:39.883795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d4273-48ad-40f6-bb27-642e49daab5e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:39.884064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d4273-48ad-40f6-bb27-642e49daab5e None admin] PATH_INFO: `/v3/projects/64ab4b385c114cf2abce492172b66b1b` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:39.885160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d4273-48ad-40f6-bb27-642e49daab5e None admin] RBAC: Authorizing `identity:get_project(project_id=64ab4b385c114cf2abce492172b66b1b)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:39.886575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d4273-48ad-40f6-bb27-642e49daab5e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:39.888190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 418/855] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:12:39 2022] GET /identity/v3/projects/64ab4b385c114cf2abce492172b66b1b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:39.894368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:39.987787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930bd9-9633-4c24-b9ea-82e6566e552a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:40.020103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb8bb-b299-48c0-9909-b080f11454c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:40.020648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb8bb-b299-48c0-9909-b080f11454c6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:40.020927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb8bb-b299-48c0-9909-b080f11454c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:40.021200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb8bb-b299-48c0-9909-b080f11454c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:40.021926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb8bb-b299-48c0-9909-b080f11454c6 None admin] RBAC: Adding query filter params (role.id=c2a5de5e2b0745e89cd777db9a2d1099, scope.project.id=64ab4b385c114cf2abce492172b66b1b, user.id=6b8cd7aa97254a37bf619d364b3fc169) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:40.022238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb8bb-b299-48c0-9909-b080f11454c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:40.023682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb8bb-b299-48c0-9909-b080f11454c6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:40.029332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 438/856] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:12:39 2022] GET /identity/v3/role_assignments?user.id=6b8cd7aa97254a37bf619d364b3fc169&scope.project.id=64ab4b385c114cf2abce492172b66b1b&role.id=c2a5de5e2b0745e89cd777db9a2d1099 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:42.125210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f7ed-6348-4752-95c4-a441141328e8 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:42.125741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f7ed-6348-4752-95c4-a441141328e8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:42.125741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f7ed-6348-4752-95c4-a441141328e8 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:42.127765 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 419/857] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:42.133112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb453-4781-4da1-bd99-9b9b1c3909f3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:42.133504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb453-4781-4da1-bd99-9b9b1c3909f3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:42.133667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb453-4781-4da1-bd99-9b9b1c3909f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:42.151331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-dbdfb453-4781-4da1-bd99-9b9b1c3909f3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:42.152522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dbdfb453-4781-4da1-bd99-9b9b1c3909f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:42.207967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:42.219041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 439/858] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:42.484103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83f7ed-6348-4752-95c4-a441141328e8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:42.562564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:42.585213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83f7ed-6348-4752-95c4-a441141328e8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:42.618360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20b3c-c9bc-4275-8386-cb5fb3308e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:42.618975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20b3c-c9bc-4275-8386-cb5fb3308e7e None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:42.619288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20b3c-c9bc-4275-8386-cb5fb3308e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:42.619566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20b3c-c9bc-4275-8386-cb5fb3308e7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:42.620688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20b3c-c9bc-4275-8386-cb5fb3308e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:42.622121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20b3c-c9bc-4275-8386-cb5fb3308e7e None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:42.623702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 420/859] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:42.629367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb453-4781-4da1-bd99-9b9b1c3909f3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:42.722487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb453-4781-4da1-bd99-9b9b1c3909f3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:42.754498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f631df9-9116-4eb9-b67e-b7a626198a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:42.755043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f631df9-9116-4eb9-b67e-b7a626198a8c None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:42.755358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f631df9-9116-4eb9-b67e-b7a626198a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:42.755630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f631df9-9116-4eb9-b67e-b7a626198a8c None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:42.756282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f631df9-9116-4eb9-b67e-b7a626198a8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:42.757702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f631df9-9116-4eb9-b67e-b7a626198a8c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:42.783319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 440/860] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:12:42 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:44.911754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c1ef-3ab3-408f-964f-8471bbbd6089 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:44.912316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c1ef-3ab3-408f-964f-8471bbbd6089 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:44.912316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c1ef-3ab3-408f-964f-8471bbbd6089 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:44.913641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 421/861] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:44.918961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce7af4-b680-479c-88d2-66362a4fac6c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:44.919414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce7af4-b680-479c-88d2-66362a4fac6c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:44.919536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce7af4-b680-479c-88d2-66362a4fac6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:44.937255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-10ce7af4-b680-479c-88d2-66362a4fac6c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:44.938449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-10ce7af4-b680-479c-88d2-66362a4fac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:44.973071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:45.004365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 441/862] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:45.273376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c1ef-3ab3-408f-964f-8471bbbd6089 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:45.371172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c1ef-3ab3-408f-964f-8471bbbd6089 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:45.403773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1f478-6824-47cd-84c0-26e91cb6ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:45.404381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1f478-6824-47cd-84c0-26e91cb6ee7d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:45.404659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1f478-6824-47cd-84c0-26e91cb6ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:45.404928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1f478-6824-47cd-84c0-26e91cb6ee7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:45.406028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1f478-6824-47cd-84c0-26e91cb6ee7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:45.407499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1f478-6824-47cd-84c0-26e91cb6ee7d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:45.409039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 422/863] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:12:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:45.414595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce7af4-b680-479c-88d2-66362a4fac6c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:45.511056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce7af4-b680-479c-88d2-66362a4fac6c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:45.544087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2edd7-4c05-4df2-9c10-673978ac2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:45.544683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2edd7-4c05-4df2-9c10-673978ac2af0 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:45.544967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2edd7-4c05-4df2-9c10-673978ac2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:45.545242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2edd7-4c05-4df2-9c10-673978ac2af0 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:45.545887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2edd7-4c05-4df2-9c10-673978ac2af0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:45.547338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2edd7-4c05-4df2-9c10-673978ac2af0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:45.568589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 442/864] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:12:45 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:47.737182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63ae2-18c1-4383-ba55-08d3e3aac6f9 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:47.737719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63ae2-18c1-4383-ba55-08d3e3aac6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:47.737719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63ae2-18c1-4383-ba55-08d3e3aac6f9 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:47.739099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 423/865] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:47.744089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d429b0-c4db-4c2b-902a-08853d04c689 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:47.744509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d429b0-c4db-4c2b-902a-08853d04c689 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:47.744639 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d429b0-c4db-4c2b-902a-08853d04c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:47.762775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a8d429b0-c4db-4c2b-902a-08853d04c689 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:47.763993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a8d429b0-c4db-4c2b-902a-08853d04c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:47.786313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:47.831141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 443/866] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:48.096227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63ae2-18c1-4383-ba55-08d3e3aac6f9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:48.112169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:48.196875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63ae2-18c1-4383-ba55-08d3e3aac6f9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:48.229218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:48.229834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:48.230115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:48.230392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:48.240682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:48.245441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:48.246531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:12:48.247779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 424/867] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:12:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:48.253097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d429b0-c4db-4c2b-902a-08853d04c689 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:48.348155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d429b0-c4db-4c2b-902a-08853d04c689 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:48.380939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:48.381532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:48.381807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:48.382075 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:48.382723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:48.383021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:48.384397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:48.392208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 444/868] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:12:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:48.398005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:48.470536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:48.495301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522875-6707-4fb5-8d03-dd2a66e8dfb8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:48.527037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:48.527673 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:48.527949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:48.528221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] PATH_INFO: `/v3/users/df4f451fde8a48bfa042e39385d2b510` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:48.541143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] RBAC: Authorizing `identity:get_user(user_id=df4f451fde8a48bfa042e39385d2b510)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:48.542567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:48.544166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 425/869] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:48 2022] GET /identity/v3/users/df4f451fde8a48bfa042e39385d2b510 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:48.550366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:48.571905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:48.645629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842dca-7d76-4343-82bb-da9cf8dc9c6c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:48.677826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247967-74d7-4e13-8c93-dbc7ec5a1fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:48.678435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247967-74d7-4e13-8c93-dbc7ec5a1fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:48.678714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247967-74d7-4e13-8c93-dbc7ec5a1fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:48.678988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247967-74d7-4e13-8c93-dbc7ec5a1fb6 None admin] PATH_INFO: `/v3/projects/9488c083528942d8915e5c1384266aba` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:48.680116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247967-74d7-4e13-8c93-dbc7ec5a1fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=9488c083528942d8915e5c1384266aba)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:48.681531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247967-74d7-4e13-8c93-dbc7ec5a1fb6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:48.683141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 445/870] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:12:48 2022] GET /identity/v3/projects/9488c083528942d8915e5c1384266aba => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:48.688783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:48.783310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cf973-6a66-4bf5-9ff1-8c6daeca5408 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:48.812369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:48.817792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa3464-099c-4b57-b7d4-f72d888d094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:48.818438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3464-099c-4b57-b7d4-f72d888d094d None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:48.818718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3464-099c-4b57-b7d4-f72d888d094d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:48.818990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3464-099c-4b57-b7d4-f72d888d094d None admin] PATH_INFO: `/v3/projects/9488c083528942d8915e5c1384266aba/users/df4f451fde8a48bfa042e39385d2b510/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:48.820940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa3464-099c-4b57-b7d4-f72d888d094d None admin] RBAC: Authorizing `identity:create_grant(project_id=9488c083528942d8915e5c1384266aba, user_id=df4f451fde8a48bfa042e39385d2b510, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:48.822370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa3464-099c-4b57-b7d4-f72d888d094d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:48.834801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 426/871] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:12:48 2022] PUT /identity/v3/projects/9488c083528942d8915e5c1384266aba/users/df4f451fde8a48bfa042e39385d2b510/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:12:50.935902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f25a-54c2-4ebe-8e88-974e62c62baa None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:50.936465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f25a-54c2-4ebe-8e88-974e62c62baa None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:50.936465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f25a-54c2-4ebe-8e88-974e62c62baa None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:50.937774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 446/872] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:50.943861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f62c3-b5b9-4142-ad49-5c58e97ac356 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:50.944279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f62c3-b5b9-4142-ad49-5c58e97ac356 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:50.944386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f62c3-b5b9-4142-ad49-5c58e97ac356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:50.962453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5a8f62c3-b5b9-4142-ad49-5c58e97ac356 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:50.963663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5a8f62c3-b5b9-4142-ad49-5c58e97ac356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:51.027099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 427/873] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:51.295859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343f25a-54c2-4ebe-8e88-974e62c62baa None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:51.381359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:51.394743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343f25a-54c2-4ebe-8e88-974e62c62baa None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:51.426735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:51.427378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:51.427657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:51.427926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:51.437950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:12:51.443454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:12:51.444619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:12:51.445830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 447/874] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:12:51.450514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f62c3-b5b9-4142-ad49-5c58e97ac356 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:51.545999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f62c3-b5b9-4142-ad49-5c58e97ac356 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:51.568296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:51.580253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:51.580852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:51.581130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:51.581403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:51.582058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:51.582360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:51.583760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:51.591739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 428/875] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:51.598156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:51.692308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc829ea-4578-4a39-9230-eccf350ed9cb None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:51.723751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:51.724359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:51.724637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:51.724908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] PATH_INFO: `/v3/users/df4f451fde8a48bfa042e39385d2b510` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:51.726005 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] RBAC: Authorizing `identity:get_user(user_id=df4f451fde8a48bfa042e39385d2b510)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:51.727448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:51.728984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 448/876] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:12:51 2022] GET /identity/v3/users/df4f451fde8a48bfa042e39385d2b510 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:51.734703 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:51.832206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe033-c8d9-49aa-bf1c-c902919f14e7 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:51.864940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:51.865530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:51.865808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:51.866077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:51.916360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:51.932366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:51.933802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:52.027020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 429/877] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:12:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:12:52.033560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:52.051256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:52.129245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328203b-dcad-4f75-8ecd-76476e1cb445 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:52.161346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfb0be-a1d6-4a98-9704-a6b3dc6b2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:52.161959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb0be-a1d6-4a98-9704-a6b3dc6b2252 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:52.162240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb0be-a1d6-4a98-9704-a6b3dc6b2252 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:52.162514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb0be-a1d6-4a98-9704-a6b3dc6b2252 None admin] PATH_INFO: `/v3/projects/9488c083528942d8915e5c1384266aba` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:52.163643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb0be-a1d6-4a98-9704-a6b3dc6b2252 None admin] RBAC: Authorizing `identity:get_project(project_id=9488c083528942d8915e5c1384266aba)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:52.165073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfb0be-a1d6-4a98-9704-a6b3dc6b2252 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:52.166689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 449/878] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:12:52 2022] GET /identity/v3/projects/9488c083528942d8915e5c1384266aba => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:52.172830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:52.254036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:52.270067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a321f-6b15-47ee-ba8a-1aa596f0a7d3 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:52.302511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a81e1-92fa-4212-b872-bca52f1a9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:52.303143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a81e1-92fa-4212-b872-bca52f1a9580 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:52.303451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a81e1-92fa-4212-b872-bca52f1a9580 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:52.303733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a81e1-92fa-4212-b872-bca52f1a9580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:52.304471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a81e1-92fa-4212-b872-bca52f1a9580 None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=9488c083528942d8915e5c1384266aba, user.id=df4f451fde8a48bfa042e39385d2b510) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:12:52.304783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a81e1-92fa-4212-b872-bca52f1a9580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:52.306222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a81e1-92fa-4212-b872-bca52f1a9580 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:52.311996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 430/879] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:12:52 2022] GET /identity/v3/role_assignments?user.id=df4f451fde8a48bfa042e39385d2b510&scope.project.id=9488c083528942d8915e5c1384266aba&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:54.441929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1159b71-6881-4f57-a285-2c87039ff808 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:54.442450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1159b71-6881-4f57-a285-2c87039ff808 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:54.442450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1159b71-6881-4f57-a285-2c87039ff808 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:54.443779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 450/880] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:54.449034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d959-2bd6-4a53-af3e-27ff138bdb89 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:54.449455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d959-2bd6-4a53-af3e-27ff138bdb89 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:54.449561 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d959-2bd6-4a53-af3e-27ff138bdb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:54.467803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7324d959-2bd6-4a53-af3e-27ff138bdb89 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:54.468978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7324d959-2bd6-4a53-af3e-27ff138bdb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:54.533187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 431/881] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:54.798792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1159b71-6881-4f57-a285-2c87039ff808 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:54.881088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:54.898084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1159b71-6881-4f57-a285-2c87039ff808 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:54.930200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d2713-2b6d-49e4-bf6a-32995c1ae2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:54.930794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2713-2b6d-49e4-bf6a-32995c1ae2e0 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:54.931097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2713-2b6d-49e4-bf6a-32995c1ae2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:54.931375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2713-2b6d-49e4-bf6a-32995c1ae2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:54.932034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2713-2b6d-49e4-bf6a-32995c1ae2e0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:54.933399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2713-2b6d-49e4-bf6a-32995c1ae2e0 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:54.948457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 451/882] 10.222.0.46 () {60 vars in 1138 bytes} [Wed Oct 19 13:12:54 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:57.092875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18266d2-8299-451b-b6cb-5aa5855e3a82 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:57.093404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18266d2-8299-451b-b6cb-5aa5855e3a82 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:57.093404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18266d2-8299-451b-b6cb-5aa5855e3a82 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:57.094809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 432/883] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:57.100199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0082b3f-4269-4e7a-a9f5-252209cd1e82 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:57.100571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0082b3f-4269-4e7a-a9f5-252209cd1e82 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:57.100799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0082b3f-4269-4e7a-a9f5-252209cd1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:57.119000 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a0082b3f-4269-4e7a-a9f5-252209cd1e82 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:57.120206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a0082b3f-4269-4e7a-a9f5-252209cd1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:57.184214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 452/884] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:12:57.454929 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18266d2-8299-451b-b6cb-5aa5855e3a82 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:57.530530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:57.553633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18266d2-8299-451b-b6cb-5aa5855e3a82 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:57.586190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e987da4-506a-4bfc-9c67-5f7eb52f9adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:57.586801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987da4-506a-4bfc-9c67-5f7eb52f9adb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:57.587102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987da4-506a-4bfc-9c67-5f7eb52f9adb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:57.587377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987da4-506a-4bfc-9c67-5f7eb52f9adb None admin] PATH_INFO: `/v3/domains/906b3f8519ef45cda9c50ad3b347d5f7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:57.598154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987da4-506a-4bfc-9c67-5f7eb52f9adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=906b3f8519ef45cda9c50ad3b347d5f7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:57.599627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987da4-506a-4bfc-9c67-5f7eb52f9adb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:57.601249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 433/885] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Oct 19 13:12:57 2022] GET /identity/v3/domains/906b3f8519ef45cda9c50ad3b347d5f7 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:12:57.606968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0082b3f-4269-4e7a-a9f5-252209cd1e82 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:12:57.678515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:57.709068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0082b3f-4269-4e7a-a9f5-252209cd1e82 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:12:57.741765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0a1ee-ba84-4628-a043-a33f1022e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:12:57.742371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a1ee-ba84-4628-a043-a33f1022e5a3 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:57.742645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a1ee-ba84-4628-a043-a33f1022e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:57.742916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a1ee-ba84-4628-a043-a33f1022e5a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:57.743599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0a1ee-ba84-4628-a043-a33f1022e5a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:12:57.745027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0a1ee-ba84-4628-a043-a33f1022e5a3 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:12:57.770162 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 453/886] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:12:57 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:12:59.902416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639179-8391-4384-bd76-ec324f2ce1cf None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:59.902952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639179-8391-4384-bd76-ec324f2ce1cf None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:59.902952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639179-8391-4384-bd76-ec324f2ce1cf None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:59.904335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 434/887] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:12:59.909572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb835b-c73d-4489-b13f-7b7723112211 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:12:59.909972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb835b-c73d-4489-b13f-7b7723112211 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:12:59.910115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb835b-c73d-4489-b13f-7b7723112211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:12:59.927647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ffdb835b-c73d-4489-b13f-7b7723112211 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:12:59.928821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ffdb835b-c73d-4489-b13f-7b7723112211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:12:59.991545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 454/888] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:12:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:13:00.263757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639179-8391-4384-bd76-ec324f2ce1cf None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:00.363320 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639179-8391-4384-bd76-ec324f2ce1cf None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:00.395804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870daba-86bb-4d5b-8558-fe4ddf3c3550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:00.396413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870daba-86bb-4d5b-8558-fe4ddf3c3550 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:00.396692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870daba-86bb-4d5b-8558-fe4ddf3c3550 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:00.396963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870daba-86bb-4d5b-8558-fe4ddf3c3550 None admin] PATH_INFO: `/v3/domains/906b3f8519ef45cda9c50ad3b347d5f7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:00.398073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870daba-86bb-4d5b-8558-fe4ddf3c3550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=906b3f8519ef45cda9c50ad3b347d5f7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:00.399542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870daba-86bb-4d5b-8558-fe4ddf3c3550 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:00.401111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 435/889] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Oct 19 13:13:00 2022] GET /identity/v3/domains/906b3f8519ef45cda9c50ad3b347d5f7 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:00.406730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb835b-c73d-4489-b13f-7b7723112211 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:00.460970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:00.503367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb835b-c73d-4489-b13f-7b7723112211 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:00.536075 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d349d6-fe1a-48b1-ae40-b66ff5da0a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:00.536682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d349d6-fe1a-48b1-ae40-b66ff5da0a3d None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:00.536961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d349d6-fe1a-48b1-ae40-b66ff5da0a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:00.537235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d349d6-fe1a-48b1-ae40-b66ff5da0a3d None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:00.537894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d349d6-fe1a-48b1-ae40-b66ff5da0a3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:00.539353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d349d6-fe1a-48b1-ae40-b66ff5da0a3d None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:00.560299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 455/890] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:13:00 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:13:02.717606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582fb1-d2e8-4a6d-825b-8f801c00d269 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:02.718160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582fb1-d2e8-4a6d-825b-8f801c00d269 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:02.718160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582fb1-d2e8-4a6d-825b-8f801c00d269 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:02.719547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 436/891] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:13:02.725353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91156d-7837-4862-b919-afa8cae08484 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:02.725777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91156d-7837-4862-b919-afa8cae08484 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:02.725911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91156d-7837-4862-b919-afa8cae08484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:02.744337 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-de91156d-7837-4862-b919-afa8cae08484 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:13:02.745525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-de91156d-7837-4862-b919-afa8cae08484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:13:02.808983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 456/892] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:13:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:13:03.076435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582fb1-d2e8-4a6d-825b-8f801c00d269 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:03.085813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:03.177138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582fb1-d2e8-4a6d-825b-8f801c00d269 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:03.210687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:03.211334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:03.211616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:03.211890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:03.222283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:13:03.227047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:13:03.228067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:13:03.228996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 437/893] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:13:03.234176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91156d-7837-4862-b919-afa8cae08484 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:03.275446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:03.328706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91156d-7837-4862-b919-afa8cae08484 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:03.360903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:03.361492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:03.361766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:03.362033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:03.362686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:13:03.362982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:03.364395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:03.371971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 457/894] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:03.377805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:03.442032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:03.476791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fb441-3691-4d07-8dd0-177aa4cbd89b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:03.510128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:03.510741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:03.511017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:03.511314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] PATH_INFO: `/v3/users/c6c592a91efb47a0b85c76e6b5b128ee` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:03.524555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] RBAC: Authorizing `identity:get_user(user_id=c6c592a91efb47a0b85c76e6b5b128ee)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:03.525997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:03.527608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 438/895] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:13:03 2022] GET /identity/v3/users/c6c592a91efb47a0b85c76e6b5b128ee => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:03.533378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:03.629625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35a253-62c5-4cbe-9184-a1efb6994ad6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:03.631842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:03.661674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94281d8c-a8fe-4d89-a683-3e44706d9767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:03.662299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281d8c-a8fe-4d89-a683-3e44706d9767 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:03.662574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281d8c-a8fe-4d89-a683-3e44706d9767 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:03.662844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281d8c-a8fe-4d89-a683-3e44706d9767 None admin] PATH_INFO: `/v3/projects/8bfb044311394223a1c0b623dd62dfb1` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:03.663964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94281d8c-a8fe-4d89-a683-3e44706d9767 None admin] RBAC: Authorizing `identity:get_project(project_id=8bfb044311394223a1c0b623dd62dfb1)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:03.665377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94281d8c-a8fe-4d89-a683-3e44706d9767 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:03.666977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 458/896] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:13:03 2022] GET /identity/v3/projects/8bfb044311394223a1c0b623dd62dfb1 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:03.672933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:03.769621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeb14f-3fce-484b-8012-45a5d3aad1cb None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:03.792070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:03.803310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24e8e-6683-47a9-937e-70484e233384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:03.803960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24e8e-6683-47a9-937e-70484e233384 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:03.804240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24e8e-6683-47a9-937e-70484e233384 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:03.804516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24e8e-6683-47a9-937e-70484e233384 None admin] PATH_INFO: `/v3/projects/8bfb044311394223a1c0b623dd62dfb1/users/c6c592a91efb47a0b85c76e6b5b128ee/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:03.806894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d24e8e-6683-47a9-937e-70484e233384 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bfb044311394223a1c0b623dd62dfb1, user_id=c6c592a91efb47a0b85c76e6b5b128ee, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:03.808364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d24e8e-6683-47a9-937e-70484e233384 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:03.820973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 439/897] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:13:03 2022] PUT /identity/v3/projects/8bfb044311394223a1c0b623dd62dfb1/users/c6c592a91efb47a0b85c76e6b5b128ee/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:13:05.919737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8294-24ca-46d2-91ef-6a8909dd44f2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:05.920306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8294-24ca-46d2-91ef-6a8909dd44f2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:05.920306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8294-24ca-46d2-91ef-6a8909dd44f2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:05.921619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 459/898] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:13:05.926924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d361490-21aa-4969-a9f3-6a8348e68730 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:05.927395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d361490-21aa-4969-a9f3-6a8348e68730 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:05.927498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d361490-21aa-4969-a9f3-6a8348e68730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:05.946027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6d361490-21aa-4969-a9f3-6a8348e68730 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:13:05.947253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6d361490-21aa-4969-a9f3-6a8348e68730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:13:06.010937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 440/899] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:13:06.278764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8294-24ca-46d2-91ef-6a8909dd44f2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:06.375681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8294-24ca-46d2-91ef-6a8909dd44f2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:06.407337 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:06.407948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:06.408229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:06.408503 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:06.418496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:13:06.423732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:13:06.424824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:13:06.426014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 460/900] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:13:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:13:06.430610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d361490-21aa-4969-a9f3-6a8348e68730 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:06.525633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d361490-21aa-4969-a9f3-6a8348e68730 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:06.539492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:06.560316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:06.560917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:06.561198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:06.561470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:06.562126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:13:06.562431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:06.563864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:06.572286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 441/901] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:13:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:06.578326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:06.608979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:06.675048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692da670-85ab-46d5-ab85-6bd08f518bfd None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:06.706641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:06.707280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:06.707562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:06.707838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] PATH_INFO: `/v3/users/c6c592a91efb47a0b85c76e6b5b128ee` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:06.708947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] RBAC: Authorizing `identity:get_user(user_id=c6c592a91efb47a0b85c76e6b5b128ee)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:06.710361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:06.711938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 461/902] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Oct 19 13:13:06 2022] GET /identity/v3/users/c6c592a91efb47a0b85c76e6b5b128ee => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:06.717553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:06.814226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13e00-3680-406f-985c-3c39888b974b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:06.847380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:06.847974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:06.848254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:06.848527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:06.890726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:06.914792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:06.916281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:07.010880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 442/903] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:13:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 19 13:13:07.017247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:07.110216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:07.113280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc0013-2570-49e3-aa2c-6a4dae0fcc3e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:07.145317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660f902-77e1-4bcc-8cc8-2bcff267337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:07.145935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f902-77e1-4bcc-8cc8-2bcff267337a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:07.146214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f902-77e1-4bcc-8cc8-2bcff267337a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:07.146487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660f902-77e1-4bcc-8cc8-2bcff267337a None admin] PATH_INFO: `/v3/projects/8bfb044311394223a1c0b623dd62dfb1` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:07.147735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660f902-77e1-4bcc-8cc8-2bcff267337a None admin] RBAC: Authorizing `identity:get_project(project_id=8bfb044311394223a1c0b623dd62dfb1)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:07.149148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660f902-77e1-4bcc-8cc8-2bcff267337a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:07.150739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 462/904] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Oct 19 13:13:07 2022] GET /identity/v3/projects/8bfb044311394223a1c0b623dd62dfb1 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:07.156657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:13:07.232927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:07.256046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78086f8e-97d2-4364-8f57-6f9ed3364682 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:13:07.288472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4daad-1d3d-4bdb-b1b2-87a91df88fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:13:07.289063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4daad-1d3d-4bdb-b1b2-87a91df88fff None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:13:07.289340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4daad-1d3d-4bdb-b1b2-87a91df88fff None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:13:07.289610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4daad-1d3d-4bdb-b1b2-87a91df88fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:13:07.290326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4daad-1d3d-4bdb-b1b2-87a91df88fff None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=8bfb044311394223a1c0b623dd62dfb1, user.id=c6c592a91efb47a0b85c76e6b5b128ee) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:13:07.290631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4daad-1d3d-4bdb-b1b2-87a91df88fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:13:07.292075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4daad-1d3d-4bdb-b1b2-87a91df88fff None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:13:07.297566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 443/905] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:13:07 2022] GET /identity/v3/role_assignments?user.id=c6c592a91efb47a0b85c76e6b5b128ee&scope.project.id=8bfb044311394223a1c0b623dd62dfb1&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:13:17.140790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=16 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:17.295264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=30 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:02.630670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbd8f1-bce0-415e-8f22-88f6f693847f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:02.631278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbd8f1-bce0-415e-8f22-88f6f693847f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:02.631278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbd8f1-bce0-415e-8f22-88f6f693847f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:02.633010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 463/906] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:02.639209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde9b57-9aea-4a66-aca2-81c5310a549f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:02.639739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde9b57-9aea-4a66-aca2-81c5310a549f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:02.639739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde9b57-9aea-4a66-aca2-81c5310a549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:02.661977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1fde9b57-9aea-4a66-aca2-81c5310a549f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:02.663442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1fde9b57-9aea-4a66-aca2-81c5310a549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:02.755884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 444/907] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:03.049696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbd8f1-bce0-415e-8f22-88f6f693847f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:03.184167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbd8f1-bce0-415e-8f22-88f6f693847f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:03.224736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:03.225782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:03.226276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:03.226754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:03.239865 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:03.241693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:03.258606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:03.259749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:03.260761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:03.260761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:03.260761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:03.267203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 464/908] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:14:03.273870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde9b57-9aea-4a66-aca2-81c5310a549f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:03.398657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde9b57-9aea-4a66-aca2-81c5310a549f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:03.432433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:03.441463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6074e-b59e-494d-b0c9-b70696995d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:03.442284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6074e-b59e-494d-b0c9-b70696995d54 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:03.442714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6074e-b59e-494d-b0c9-b70696995d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:03.443020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6074e-b59e-494d-b0c9-b70696995d54 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:03.443875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6074e-b59e-494d-b0c9-b70696995d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:03.444249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6074e-b59e-494d-b0c9-b70696995d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:03.445753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6074e-b59e-494d-b0c9-b70696995d54 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:03.465875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 445/909] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:03.467058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:03.533502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:03.603388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3aa25-22e5-4382-b923-98e0585bb869 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:03.648773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3d076-fc0a-439a-b37e-5a5a2842cd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:03.655106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d076-fc0a-439a-b37e-5a5a2842cd1b None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:03.655106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d076-fc0a-439a-b37e-5a5a2842cd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:03.655106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d076-fc0a-439a-b37e-5a5a2842cd1b None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:03.655106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3d076-fc0a-439a-b37e-5a5a2842cd1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:03.655106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3d076-fc0a-439a-b37e-5a5a2842cd1b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:03.680785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 465/910] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Oct 19 13:14:03 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:14:05.962920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcf5b2-cd7e-4188-9536-43a1c6262d50 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:05.963550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcf5b2-cd7e-4188-9536-43a1c6262d50 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:05.963550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcf5b2-cd7e-4188-9536-43a1c6262d50 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:05.964892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 446/911] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:05.970539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90910b-f736-4db1-916f-93085aee1294 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:05.971024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90910b-f736-4db1-916f-93085aee1294 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:05.971237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90910b-f736-4db1-916f-93085aee1294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:05.991318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1d90910b-f736-4db1-916f-93085aee1294 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:05.992681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1d90910b-f736-4db1-916f-93085aee1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:06.074659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 466/912] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:06.366955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcf5b2-cd7e-4188-9536-43a1c6262d50 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:06.489769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcf5b2-cd7e-4188-9536-43a1c6262d50 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:06.529971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:06.531237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:06.531546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:06.531870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:06.543210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:14:06.548676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:06.549686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:06.550536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 447/913] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:06.555889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90910b-f736-4db1-916f-93085aee1294 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:06.601856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:06.674499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90910b-f736-4db1-916f-93085aee1294 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:06.712567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:06.713377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:06.713823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:06.714184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:06.714999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] RBAC: Adding query filter params (name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:06.715463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:06.717030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:06.726413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 467/914] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:06.732385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:06.794175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:06.853080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe1805-6a06-42d0-b913-843bbc0f4862 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:06.894288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:06.894940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:06.895248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:06.895546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:06.907426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:06.909061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:06.926725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:06.927762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:06.933412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:06.933412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:06.933412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:06.933412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 448/915] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:06.935797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:07.050811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:07.054773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ba2d5-0f91-4238-967e-89124a7b227c None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:07.096423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:07.097047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:07.097331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:07.097636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:07.098287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:07.098593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:07.100010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:07.112542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 468/916] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:07.118255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:07.242002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533b797-e5dd-42df-8465-90b8fc733544 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:07.243571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:07.279405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:07.280059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:07.280935 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:07.281134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:07.289657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:07.291250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:14:07.303850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:07.304852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:07.305818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 449/917] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:14:07.310907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:07.417821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafec6-4c97-4722-b538-38d80dd105ac None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:07.454655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:07.455222 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:07.455509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:07.455780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:07.456529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:07.456907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:07.458255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:07.476554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 469/918] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Oct 19 13:14:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:07.482420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:07.601401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ed610-3dc8-4c70-a8fd-297d6c3fd2f8 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:07.641356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:07.642735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:07.642735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:07.642939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:07.654573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:07.656733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:07.673631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:07.674662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:07.675622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:07.675622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:07.675622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:07.675622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 450/919] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:07.680517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:07.700246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:07.789435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38a57-3a44-467a-a82e-917148c12f57 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:07.825321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:07.825936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:07.826300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:07.826516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:07.827733 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:07.828080 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:07.829450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:07.846851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 470/920] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:07.848238 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:07.870041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:07.964403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54569-cee0-4d81-ac7e-60803439586a None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:08.002126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:08.002783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:08.003059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:08.003352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:08.012443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:08.013891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:14:08.025735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:08.026626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:08.027887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 451/921] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:14:08.033082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:08.126454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:08.151004 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ee7d8-71b1-4749-ac01-74afec49b543 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:08.193699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6ac89-2cb7-4762-a6c9-68bb2022fccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:08.194246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ac89-2cb7-4762-a6c9-68bb2022fccc None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:08.194521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ac89-2cb7-4762-a6c9-68bb2022fccc None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:08.194797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ac89-2cb7-4762-a6c9-68bb2022fccc None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:08.195520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ac89-2cb7-4762-a6c9-68bb2022fccc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:08.195823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ac89-2cb7-4762-a6c9-68bb2022fccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:08.199981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ac89-2cb7-4762-a6c9-68bb2022fccc None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:08.212990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 471/922] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:14:08.219750 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:08.303024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:08.330627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afcafe-077d-440e-a2b9-d22c0122ccfa None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:08.368661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf998d-855c-4887-b415-0a7e7101ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:08.369346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf998d-855c-4887-b415-0a7e7101ea51 None admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:08.369624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf998d-855c-4887-b415-0a7e7101ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:08.369899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf998d-855c-4887-b415-0a7e7101ea51 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1b620598f694d4bae6a96822fc7e843/roles/4ca7ffa01f0e4e27906254cb664bc03f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:08.386642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf998d-855c-4887-b415-0a7e7101ea51 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=c1b620598f694d4bae6a96822fc7e843, role_id=4ca7ffa01f0e4e27906254cb664bc03f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:08.388447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf998d-855c-4887-b415-0a7e7101ea51 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:08.400944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 452/923] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:14:08 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1b620598f694d4bae6a96822fc7e843/roles/4ca7ffa01f0e4e27906254cb664bc03f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:14:10.862443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1f4f7-7553-4637-961f-e35535e7e725 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:10.863054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1f4f7-7553-4637-961f-e35535e7e725 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:10.863054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1f4f7-7553-4637-961f-e35535e7e725 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:10.864855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 472/924] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:10.870476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e385469-9d1f-4285-922b-5bc48166ebc2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:10.870968 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e385469-9d1f-4285-922b-5bc48166ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:10.871059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e385469-9d1f-4285-922b-5bc48166ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:10.890316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0e385469-9d1f-4285-922b-5bc48166ebc2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:10.891548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0e385469-9d1f-4285-922b-5bc48166ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:10.960445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 453/925] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:11.237660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1f4f7-7553-4637-961f-e35535e7e725 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:11.351668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1f4f7-7553-4637-961f-e35535e7e725 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:11.390285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:11.390915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:11.391232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:11.391502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:11.398757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.403131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:14:11.408515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:11.409658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 19 13:14:11.410709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:11.411789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 473/926] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Oct 19 13:14:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:11.418578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e385469-9d1f-4285-922b-5bc48166ebc2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:11.477133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.531786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e385469-9d1f-4285-922b-5bc48166ebc2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:11.569514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:11.570128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:11.570516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:11.570688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:11.571388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:11.571694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:11.573071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:11.581291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 454/927] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Oct 19 13:14:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:11.587861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:11.697680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258a799-e253-4b77-bc7e-de771a914a86 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:11.736748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:11.737405 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:11.737720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:11.737995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:11.749211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:11.750654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:11.765573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:11.766727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:11.767879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:11.767879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:11.767879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:11.767879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 474/928] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:11.772647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:11.885716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cef15c-72ee-488c-b869-4c28e59d8a55 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:11.902603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.923280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:11.923978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:11.924298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:11.924572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:11.925223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:11.925524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:11.927047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:11.939697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 455/929] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:11.945895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:12.008566 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:12.061746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31139d-a80c-4ff3-82ee-b817c4c19349 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:12.099562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:12.100124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:12.100488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:12.100767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:12.108538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:12.109969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:14:12.122375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:12.123683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:12.124713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 475/930] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:12.130127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:12.242020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79836c8b-b93a-4dd2-b46a-51200e3ab778 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:12.281507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:12.282056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:12.282339 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:12.282613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:12.283404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:12.283695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:12.285152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:12.303022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 456/931] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Oct 19 13:14:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:12.308886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:12.411554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd544-63ee-429c-97c2-87db6e0ca478 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:12.422532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:12.450977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:12.451622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:12.451905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:12.452746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:12.527114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:12.528557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:12.628929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 476/932] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:14:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 13:14:12.635162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:12.671640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:12.748766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573dfe-7ab3-4ba7-99d6-8b8c78c62e6d None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:12.789798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:12.790432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:12.790707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:12.790978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:12.802827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:12.804531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:12.821497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:12.822591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:12.823538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:12.823538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:12.823538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:12.823538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 457/933] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:12.829158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:12.842414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:12.938706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c9731-90ce-4d28-8fe3-f4fb675a4650 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:12.972644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:12.973352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:12.973522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:12.973880 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:12.974439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:12.974745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:12.976176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:12.987899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 477/934] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:14:12.993795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:13.089531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:13.106307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf466-67b3-4168-98b3-e46c0257a90b None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:13.143059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:13.143719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:13.144042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:13.144314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:13.150926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:13.152414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:14:13.163663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:13.166537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:13.167494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 458/935] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:14:13.172389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:13.254183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:13.288849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39678c-3228-4d07-a5ac-28ab711e2b9a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:13.328325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e818b-b5b1-455d-a9b6-193ee124b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:13.329032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e818b-b5b1-455d-a9b6-193ee124b095 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:13.329351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e818b-b5b1-455d-a9b6-193ee124b095 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:13.329685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e818b-b5b1-455d-a9b6-193ee124b095 None admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:13.330574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e818b-b5b1-455d-a9b6-193ee124b095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:13.330877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e818b-b5b1-455d-a9b6-193ee124b095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:13.332346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e818b-b5b1-455d-a9b6-193ee124b095 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:13.345486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 478/936] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:13.351577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:13.455464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3c60-f1f2-4963-a8e9-be23e79a7032 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:13.493862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29cf9f-478c-45fc-94d3-edc0dd174f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:13.494470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29cf9f-478c-45fc-94d3-edc0dd174f1f None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:13.494743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29cf9f-478c-45fc-94d3-edc0dd174f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:13.495010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29cf9f-478c-45fc-94d3-edc0dd174f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:13.495765 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29cf9f-478c-45fc-94d3-edc0dd174f1f None admin] RBAC: Adding query filter params (role.id=4ca7ffa01f0e4e27906254cb664bc03f, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=c1b620598f694d4bae6a96822fc7e843) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:13.496071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29cf9f-478c-45fc-94d3-edc0dd174f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:13.497499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29cf9f-478c-45fc-94d3-edc0dd174f1f None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:13.503189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 459/937] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:14:13 2022] GET /identity/v3/role_assignments?user.id=c1b620598f694d4bae6a96822fc7e843&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=4ca7ffa01f0e4e27906254cb664bc03f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:15.873280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8429de-dafa-46a8-aa81-03c51344c44a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:15.873881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8429de-dafa-46a8-aa81-03c51344c44a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:15.873992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8429de-dafa-46a8-aa81-03c51344c44a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:15.875723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 479/938] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:15.882084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d630e2-71d5-45e0-b82b-c209b1e02683 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:15.882510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d630e2-71d5-45e0-b82b-c209b1e02683 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:15.882609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d630e2-71d5-45e0-b82b-c209b1e02683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:15.903526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d7d630e2-71d5-45e0-b82b-c209b1e02683 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:15.904773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d7d630e2-71d5-45e0-b82b-c209b1e02683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:15.908434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:15.982614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 460/939] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:16.277532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8429de-dafa-46a8-aa81-03c51344c44a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:16.392749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8429de-dafa-46a8-aa81-03c51344c44a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:16.424888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:16.431045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:16.431697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:16.431971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:16.432237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:16.442854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:14:16.449204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:16.450417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:16.451475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 480/940] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:16.457543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d630e2-71d5-45e0-b82b-c209b1e02683 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:16.569237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d630e2-71d5-45e0-b82b-c209b1e02683 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:16.603324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:16.604017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:16.604357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:16.604718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:16.605480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:16.605784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:16.607272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:16.621401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 461/941] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:14:16.622587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:16.737792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b10b1-dcd8-40ea-b451-a4a596072840 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:16.774719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:16.775458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:16.775694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:16.776002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:16.786551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:16.788200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:16.804642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:16.805984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:16.807167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:16.807167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:16.807167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:16.807167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 481/942] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:16.812272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:16.815783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:16.926614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093f541-e927-4c53-930e-da93db1337c1 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:16.963536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:16.964217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:16.964496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:16.964777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:16.965464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:16.965722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:16.967110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:16.981479 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 462/943] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:14:16.987865 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:17.033223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:17.096459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64bb1e-0772-4b3c-b890-dc6392632e3b None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:17.135002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:17.135975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:17.136251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:17.136528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:17.145986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:17.147777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:14:17.161539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:17.162776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:17.164414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 482/944] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 19 13:14:17.169117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:17.244437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:17.294837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781646d-8051-4756-97eb-30cec9b29562 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:17.343165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:17.343165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:17.343165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:17.343165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:17.343625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:17.343625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:17.343625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:17.362007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 463/945] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Oct 19 13:14:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:17.367670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:17.487870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ec75c-f000-4be7-a9e2-8e1e9202f11f None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:17.489457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:17.529442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:17.530085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:17.530883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:17.531174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:17.544650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:17.546133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:17.561961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:17.563202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:17.564576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:17.564576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:17.564576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:17.564576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 483/946] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:17.569711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:17.685668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea9f73-4315-4209-8c8b-4dceb9dfa127 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:17.709451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:17.725222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:17.725877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:17.726158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:17.726430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:17.727096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:17.727420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:17.728915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:17.741636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 464/947] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:17.748048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:17.865342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9556a-f93f-4429-97dc-96925ccb3af9 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:17.905956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:17.906787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:17.907146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:17.907433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:17.915654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:17.917192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:14:17.928160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:17.929301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:17.930449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 484/948] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:17.935126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:18.058975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2890d-2824-48c9-8c66-ef329399f908 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:18.099658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c5c53-528c-48be-85a3-ad039bc3851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:18.100387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c5c53-528c-48be-85a3-ad039bc3851b None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:18.100695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c5c53-528c-48be-85a3-ad039bc3851b None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:18.101004 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c5c53-528c-48be-85a3-ad039bc3851b None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:18.101730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c5c53-528c-48be-85a3-ad039bc3851b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:18.102069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c5c53-528c-48be-85a3-ad039bc3851b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:18.103828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c5c53-528c-48be-85a3-ad039bc3851b None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:18.123014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 465/949] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:18.125154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:18.141887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:18.236464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbeb84-d64b-4695-925d-5b28c5533d81 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:18.272834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de847a5-5d42-4abc-9afd-9ecfcf85fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:18.273555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de847a5-5d42-4abc-9afd-9ecfcf85fdb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:18.273836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de847a5-5d42-4abc-9afd-9ecfcf85fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:18.274112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de847a5-5d42-4abc-9afd-9ecfcf85fdb8 None admin] PATH_INFO: `/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1b620598f694d4bae6a96822fc7e843/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:18.276312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de847a5-5d42-4abc-9afd-9ecfcf85fdb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0415b19faa8341d4ac0f7d43948f0ad1, user_id=c1b620598f694d4bae6a96822fc7e843, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:18.277794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de847a5-5d42-4abc-9afd-9ecfcf85fdb8 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:18.291158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 485/950] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Oct 19 13:14:18 2022] PUT /identity/v3/projects/0415b19faa8341d4ac0f7d43948f0ad1/users/c1b620598f694d4bae6a96822fc7e843/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:14:20.560002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91fded-5f4a-4900-bb98-0bd2ab96d916 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:20.560674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91fded-5f4a-4900-bb98-0bd2ab96d916 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:20.560674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91fded-5f4a-4900-bb98-0bd2ab96d916 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:20.562359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 466/951] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:20.568117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a349-b7e6-4476-8d12-c58e4a4fa99c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:20.568543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a349-b7e6-4476-8d12-c58e4a4fa99c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:20.568709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a349-b7e6-4476-8d12-c58e4a4fa99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:20.587537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-38d5a349-b7e6-4476-8d12-c58e4a4fa99c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:20.588850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-38d5a349-b7e6-4476-8d12-c58e4a4fa99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:20.657748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 486/952] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:20.945034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91fded-5f4a-4900-bb98-0bd2ab96d916 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:20.994713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:21.060891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91fded-5f4a-4900-bb98-0bd2ab96d916 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:21.100219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:21.100944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:21.101230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:21.101584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:21.113857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 19 13:14:21.118923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:21.120226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:21.121100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 467/953] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Oct 19 13:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:21.126423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5a349-b7e6-4476-8d12-c58e4a4fa99c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:21.129820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:21.241592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5a349-b7e6-4476-8d12-c58e4a4fa99c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:21.276823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:21.277435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:21.277722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:21.278055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:21.278753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:21.279057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:21.281144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:21.296168 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 487/954] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Oct 19 13:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:21.297473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:21.402788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:21.406495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0e4c-8827-4205-8a68-84611e5419dd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:21.446548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:21.447373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:21.447698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:21.448067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:21.460416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:21.461960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:21.477568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:21.478597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:21.480122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:21.480122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:21.480122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:21.480122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 468/955] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:21.485403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:21.563638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:21.604748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f1c75-d805-485b-8009-1430525108ec None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:21.641675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:21.642428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:21.642713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:21.642986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:21.643735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:21.644107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:21.645632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:21.659752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 488/956] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:21.665446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:21.781890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef69ed-91c7-495c-83cc-d6aa24cb8ae6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:21.818211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:21.818766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:21.819043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:21.819341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:21.828342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:21.829939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 19 13:14:21.843286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:21.844524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 19 13:14:21.845638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:21.847562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 469/957] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:21.853593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:21.963183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb7699-28a8-447a-9ddf-bbdf8dfb5a4e None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:21.989293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:21.998475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:21.999163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:21.999444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:21.999715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:22.000461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:22.000771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:22.002229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:22.028544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 489/958] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Oct 19 13:14:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:22.034969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:22.050717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:22.147957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4bf0d-7e7e-49bc-b703-e467493c0ac6 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:22.181996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:22.182604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:22.182880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:22.183179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:22.250251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:22.251774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:22.266630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:22.353604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 470/959] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Oct 19 13:14:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 19 13:14:22.359874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:22.457175 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f221cc4-3d51-4d58-95c6-9f414ce96735 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:22.488651 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:22.489264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:22.489539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:22.489806 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:22.499751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:22.501169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 19 13:14:22.515478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:22.516575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 19 13:14:22.517844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 19 13:14:22.517844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 19 13:14:22.517844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:22.517844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 490/960] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:22.522246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:22.617357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c6b0-4c4c-4ca6-a1ec-82755617eb09 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:22.630351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:22.650824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:22.651441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:22.651716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:22.651984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:22.652611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:22.652909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:22.654258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:22.665074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 471/961] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Oct 19 13:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:22.671105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:22.704997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:22.766872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8e1d6-3db5-4183-b958-b8b46cc5ff35 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:22.800559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:22.801174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:22.801452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:22.801725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:22.808090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:22.809520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 19 13:14:22.821160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:22.822198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: ERROR keystone.server.flask.application Oct 19 13:14:22.823170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 491/962] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Oct 19 13:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:22.828025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:22.931224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb668b90-70b9-47e9-8c7c-1ce7aa95babd None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:22.963618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250a7f3-4b6b-4d06-a07b-d98d59b84997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:22.964215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250a7f3-4b6b-4d06-a07b-d98d59b84997 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:22.964491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250a7f3-4b6b-4d06-a07b-d98d59b84997 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:22.964759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250a7f3-4b6b-4d06-a07b-d98d59b84997 None admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:22.965441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250a7f3-4b6b-4d06-a07b-d98d59b84997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:22.965744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250a7f3-4b6b-4d06-a07b-d98d59b84997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:22.967186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250a7f3-4b6b-4d06-a07b-d98d59b84997 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:22.979140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 472/963] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Oct 19 13:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:22.985710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:23.077290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:23.083388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71511809-cc7f-4183-86e0-3b7e324357d6 None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:23.115577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d80d-a8fc-49e3-9150-8399c8781680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:23.116162 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d80d-a8fc-49e3-9150-8399c8781680 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:23.116437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d80d-a8fc-49e3-9150-8399c8781680 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:23.116705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d80d-a8fc-49e3-9150-8399c8781680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:23.117418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d80d-a8fc-49e3-9150-8399c8781680 None admin] RBAC: Adding query filter params (role.id=9f876a46b1814b3dbf30b83f8dde7ee9, scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1, user.id=c1b620598f694d4bae6a96822fc7e843) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:23.117722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d80d-a8fc-49e3-9150-8399c8781680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:23.119143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d80d-a8fc-49e3-9150-8399c8781680 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:23.124603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 492/964] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Oct 19 13:14:22 2022] GET /identity/v3/role_assignments?user.id=c1b620598f694d4bae6a96822fc7e843&scope.project.id=0415b19faa8341d4ac0f7d43948f0ad1&role.id=9f876a46b1814b3dbf30b83f8dde7ee9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:25.268943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6a7e-d7a7-4f31-9fcf-48b1750b925b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:25.269455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6a7e-d7a7-4f31-9fcf-48b1750b925b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:25.269560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6a7e-d7a7-4f31-9fcf-48b1750b925b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:25.270866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 473/965] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:25.276112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c32434-6e25-4db6-a0cd-474e6a6c33b6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:25.276515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c32434-6e25-4db6-a0cd-474e6a6c33b6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:25.276658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c32434-6e25-4db6-a0cd-474e6a6c33b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:25.294345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-14c32434-6e25-4db6-a0cd-474e6a6c33b6 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:25.295616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-14c32434-6e25-4db6-a0cd-474e6a6c33b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:25.359477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 493/966] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:25.623876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba6a7e-d7a7-4f31-9fcf-48b1750b925b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:25.654621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:25.723756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba6a7e-d7a7-4f31-9fcf-48b1750b925b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:25.756037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:25.756651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:25.756931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:25.757205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:25.757784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:25.759178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:25.768220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:25.769404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:25.770391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 474/967] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:14:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:25.775213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c32434-6e25-4db6-a0cd-474e6a6c33b6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:25.866182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:25.878903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c32434-6e25-4db6-a0cd-474e6a6c33b6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:25.921683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4db81f-bee9-4cf6-8673-3b9da3e25e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:25.922295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4db81f-bee9-4cf6-8673-3b9da3e25e31 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:25.922576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4db81f-bee9-4cf6-8673-3b9da3e25e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:25.922850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4db81f-bee9-4cf6-8673-3b9da3e25e31 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:25.923513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4db81f-bee9-4cf6-8673-3b9da3e25e31 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:25.923819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4db81f-bee9-4cf6-8673-3b9da3e25e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:25.925185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4db81f-bee9-4cf6-8673-3b9da3e25e31 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:25.929916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 494/968] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Oct 19 13:14:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:25.935768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:26.027070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:26.033197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef9947-a540-437e-b363-d39bbcd2afb2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:26.066415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43e43f-024a-491f-a4a8-f10982988ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:26.067036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e43f-024a-491f-a4a8-f10982988ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:26.067342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e43f-024a-491f-a4a8-f10982988ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:26.067617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e43f-024a-491f-a4a8-f10982988ca8 None admin] PATH_INFO: `/v3/services` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:26.068244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e43f-024a-491f-a4a8-f10982988ca8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:26.068549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e43f-024a-491f-a4a8-f10982988ca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:26.069923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e43f-024a-491f-a4a8-f10982988ca8 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:26.074276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 475/969] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Oct 19 13:14:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:28.186907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122b36-1862-4fc0-a762-9a34c3b4d1a9 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:28.187377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122b36-1862-4fc0-a762-9a34c3b4d1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:28.187479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122b36-1862-4fc0-a762-9a34c3b4d1a9 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:28.188823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 495/970] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:28.194241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c391b-4a0b-4d26-ba4d-5aa09c588b35 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:28.194679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c391b-4a0b-4d26-ba4d-5aa09c588b35 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:28.194770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c391b-4a0b-4d26-ba4d-5aa09c588b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:28.213014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-757c391b-4a0b-4d26-ba4d-5aa09c588b35 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:28.214197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-757c391b-4a0b-4d26-ba4d-5aa09c588b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:28.278857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 476/971] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:28.544192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122b36-1862-4fc0-a762-9a34c3b4d1a9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:28.642766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122b36-1862-4fc0-a762-9a34c3b4d1a9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:28.675016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bf585-36e2-41e7-b03a-d055b159be52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:28.675637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf585-36e2-41e7-b03a-d055b159be52 None admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:28.675913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf585-36e2-41e7-b03a-d055b159be52 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:28.676185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf585-36e2-41e7-b03a-d055b159be52 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:28.676839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bf585-36e2-41e7-b03a-d055b159be52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:28.678479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bf585-36e2-41e7-b03a-d055b159be52 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:28.692770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 496/972] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Oct 19 13:14:28 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:14:30.822831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6060-4931-4cc5-bde7-539cfa972773 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:30.823405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6060-4931-4cc5-bde7-539cfa972773 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:30.823405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6060-4931-4cc5-bde7-539cfa972773 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:30.824741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 477/973] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:30.830371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6f906-5e6a-4558-b468-16afe54aefff None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:30.830995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6f906-5e6a-4558-b468-16afe54aefff None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:30.830995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6f906-5e6a-4558-b468-16afe54aefff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:30.853564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d6a6f906-5e6a-4558-b468-16afe54aefff None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:30.855385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d6a6f906-5e6a-4558-b468-16afe54aefff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:30.866986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:30.934556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 497/974] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 19 13:14:31.205322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6060-4931-4cc5-bde7-539cfa972773 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:31.293464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:31.304145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6060-4931-4cc5-bde7-539cfa972773 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:31.337803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:31.338423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:31.338703 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:31.338977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:31.339588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:31.340951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:31.349469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:31.350660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:31.351793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 478/975] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:14:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:31.356495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6f906-5e6a-4558-b468-16afe54aefff None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:31.451012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6f906-5e6a-4558-b468-16afe54aefff None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:31.483588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:31.484184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:31.484464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:31.484737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:31.485365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:31.485666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:31.487030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:31.491970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 498/976] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Oct 19 13:14:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:31.497686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:31.595034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c33a0-4daa-4aa7-8b89-54161c785902 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:31.627769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd12a3-e03b-45e1-bef9-3a8e2cf420b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:31.628354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd12a3-e03b-45e1-bef9-3a8e2cf420b5 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:31.628632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd12a3-e03b-45e1-bef9-3a8e2cf420b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:31.628902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd12a3-e03b-45e1-bef9-3a8e2cf420b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:31.629595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd12a3-e03b-45e1-bef9-3a8e2cf420b5 None admin] RBAC: Adding query filter params (interface=public, service_id=5a8b45fb31ea489eb85c8f8a3d424c9a, region_id=RegionOne) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:31.629905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd12a3-e03b-45e1-bef9-3a8e2cf420b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:31.631283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd12a3-e03b-45e1-bef9-3a8e2cf420b5 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:31.636122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 479/977] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Oct 19 13:14:31 2022] GET /identity/v3/endpoints?service_id=5a8b45fb31ea489eb85c8f8a3d424c9a&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:14:31.641584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:31.645226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:31.738472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ebec4-10d7-46e4-96e1-fda08f0dac9a None admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:31.772127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f137f-bb63-4799-84e8-e3656211ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:31.772723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f137f-bb63-4799-84e8-e3656211ec58 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:31.773002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f137f-bb63-4799-84e8-e3656211ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:31.773274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f137f-bb63-4799-84e8-e3656211ec58 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:31.773901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f137f-bb63-4799-84e8-e3656211ec58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:31.775283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f137f-bb63-4799-84e8-e3656211ec58 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:31.781983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 499/978] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Oct 19 13:14:31 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:14:33.930998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da198-9f56-4e70-86c4-5f8f7c56148e None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:33.931627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da198-9f56-4e70-86c4-5f8f7c56148e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:33.931627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da198-9f56-4e70-86c4-5f8f7c56148e None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:33.932930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 480/979] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:14:33.938066 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43bf74-f164-49d2-b804-e099c399a04c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:33.938518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43bf74-f164-49d2-b804-e099c399a04c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:33.938619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43bf74-f164-49d2-b804-e099c399a04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:33.957656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4b43bf74-f164-49d2-b804-e099c399a04c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:14:33.958825 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4b43bf74-f164-49d2-b804-e099c399a04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:14:34.018164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:34.024176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 500/980] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:14:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 19 13:14:34.294572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da198-9f56-4e70-86c4-5f8f7c56148e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:34.314515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:34.394596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da198-9f56-4e70-86c4-5f8f7c56148e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:34.427219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:34.427827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:34.428102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:34.428372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:34.428952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:34.430312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 19 13:14:34.438999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 19 13:14:34.440380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.get_or_create( Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application with Lock( Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self._enter() Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application return self.creator() Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application created_value = creator( Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: ERROR keystone.server.flask.application Oct 19 13:14:34.441619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 481/981] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Oct 19 13:14:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 19 13:14:34.446007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43bf74-f164-49d2-b804-e099c399a04c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:34.540338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43bf74-f164-49d2-b804-e099c399a04c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:34.572972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0b09-4267-4c26-83c9-182146416fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:34.573568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0b09-4267-4c26-83c9-182146416fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:34.573846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0b09-4267-4c26-83c9-182146416fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:34.574116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0b09-4267-4c26-83c9-182146416fa9 None admin] PATH_INFO: `/v3/services` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:34.574741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0b09-4267-4c26-83c9-182146416fa9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:14:34.575044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0b09-4267-4c26-83c9-182146416fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:34.577043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0b09-4267-4c26-83c9-182146416fa9 None admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:34.581983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 501/982] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Oct 19 13:14:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:14:34.587564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:14:34.666559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:34.684327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a491-741a-40d9-b796-3828e36f87e2 None admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:14:34.717032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d1d8c-c999-4be5-9b83-29a2b0c192d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:14:34.718059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1d8c-c999-4be5-9b83-29a2b0c192d7 None admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:14:34.718339 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1d8c-c999-4be5-9b83-29a2b0c192d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:14:34.718611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1d8c-c999-4be5-9b83-29a2b0c192d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:14:34.719300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d1d8c-c999-4be5-9b83-29a2b0c192d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:14:34.720663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d1d8c-c999-4be5-9b83-29a2b0c192d7 None admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:14:34.739298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 482/983] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:14:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:14:44.579279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=69 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:44.734958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:38.404445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee9a6-fa14-4e69-81c2-8626f3127778 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:38.404934 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee9a6-fa14-4e69-81c2-8626f3127778 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:38.405165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee9a6-fa14-4e69-81c2-8626f3127778 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:38.406717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 502/984] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:38.412060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c4b4-ae06-4664-94ce-5cc9acecc8ad None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:38.412459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c4b4-ae06-4664-94ce-5cc9acecc8ad None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:38.412610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c4b4-ae06-4664-94ce-5cc9acecc8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:38.488391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7df3c4b4-ae06-4664-94ce-5cc9acecc8ad None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:38.489628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7df3c4b4-ae06-4664-94ce-5cc9acecc8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:38.646631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 483/985] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:38.944032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc95b-ea04-4b24-ae55-f97b6241d72e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:38.944312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc95b-ea04-4b24-ae55-f97b6241d72e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:38.944834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc95b-ea04-4b24-ae55-f97b6241d72e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:38.946270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 503/986] 10.222.0.46 () {54 vars in 964 bytes} [Wed Oct 19 13:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:38.952118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797a6b-f06d-49f5-ad73-f7a5659cfb70 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:38.952481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797a6b-f06d-49f5-ad73-f7a5659cfb70 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:38.952833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797a6b-f06d-49f5-ad73-f7a5659cfb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:39.031531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-78797a6b-f06d-49f5-ad73-f7a5659cfb70 None None] MFA Rules not processed for user `9b0ffc12a2fe49938b8a5ab56cd9721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:39.032740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78797a6b-f06d-49f5-ad73-f7a5659cfb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:39.055521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:39.115477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 484/987] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Oct 19 13:15:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:39.124798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bc95b-ea04-4b24-ae55-f97b6241d72e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:15:39.126594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-213bc95b-ea04-4b24-ae55-f97b6241d72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:39.256336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bc95b-ea04-4b24-ae55-f97b6241d72e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:15:39.344348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5985e3-59ea-43ae-9512-6d89b037ea18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:15:39.344973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5985e3-59ea-43ae-9512-6d89b037ea18 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:39.345264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5985e3-59ea-43ae-9512-6d89b037ea18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:39.345522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5985e3-59ea-43ae-9512-6d89b037ea18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:39.347499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cb5985e3-59ea-43ae-9512-6d89b037ea18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:39.410284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:39.470326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5985e3-59ea-43ae-9512-6d89b037ea18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:15:39.471722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5985e3-59ea-43ae-9512-6d89b037ea18 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:15:39.491216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 504/988] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:15:41.940029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541d7f-15bd-4baa-8856-36796038f16b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:41.940467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541d7f-15bd-4baa-8856-36796038f16b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:41.940643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541d7f-15bd-4baa-8856-36796038f16b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:41.942201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 485/989] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:41.947532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc215a-1ade-49e6-84f0-e55af2be6ed3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:41.947908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc215a-1ade-49e6-84f0-e55af2be6ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:41.948008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc215a-1ade-49e6-84f0-e55af2be6ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:42.035132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f4dc215a-1ade-49e6-84f0-e55af2be6ed3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:42.036350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f4dc215a-1ade-49e6-84f0-e55af2be6ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:42.135307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 505/990] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:42.417370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541d7f-15bd-4baa-8856-36796038f16b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:15:42.419019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e3541d7f-15bd-4baa-8856-36796038f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:42.525687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541d7f-15bd-4baa-8856-36796038f16b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:15:42.598523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:42.601148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b9c5-17df-4627-9933-268d616d30c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:15:42.601944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b9c5-17df-4627-9933-268d616d30c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:42.602385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b9c5-17df-4627-9933-268d616d30c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:42.602841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b9c5-17df-4627-9933-268d616d30c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:42.604573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c145b9c5-17df-4627-9933-268d616d30c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:42.721956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145b9c5-17df-4627-9933-268d616d30c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:15:42.723610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145b9c5-17df-4627-9933-268d616d30c4 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:15:42.743933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 486/991] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:15:45.187880 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543487-0de0-4261-a9e9-5ccccafbe8a1 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:45.188311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543487-0de0-4261-a9e9-5ccccafbe8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:45.188440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543487-0de0-4261-a9e9-5ccccafbe8a1 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:45.189808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 506/992] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:45.194907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd254a5-ced7-4018-a1a1-b4d8e068b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:45.195327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd254a5-ced7-4018-a1a1-b4d8e068b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:45.195499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd254a5-ced7-4018-a1a1-b4d8e068b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:45.259865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8cd254a5-ced7-4018-a1a1-b4d8e068b5c2 None None] MFA Rules not processed for user `2a4d5aeb2b594f3aa580d835f5be6f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:45.261701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8cd254a5-ced7-4018-a1a1-b4d8e068b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:45.312368 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:45.356573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 487/993] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:15:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:45.639708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543487-0de0-4261-a9e9-5ccccafbe8a1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:15:45.641262 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f7543487-0de0-4261-a9e9-5ccccafbe8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:45.650767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:45.742277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543487-0de0-4261-a9e9-5ccccafbe8a1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:15:45.813394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d60ff0-0771-40b9-98c1-1c1d4f83368d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:15:45.813995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d60ff0-0771-40b9-98c1-1c1d4f83368d service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:45.814271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d60ff0-0771-40b9-98c1-1c1d4f83368d service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:45.814539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d60ff0-0771-40b9-98c1-1c1d4f83368d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:45.816142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f7d60ff0-0771-40b9-98c1-1c1d4f83368d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:45.878003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:45.923202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d60ff0-0771-40b9-98c1-1c1d4f83368d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:15:45.924580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d60ff0-0771-40b9-98c1-1c1d4f83368d service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:15:45.943131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 507/994] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:15:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:15:48.617578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf880-cdaf-44dc-8e53-143282c5e57b None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:48.618125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf880-cdaf-44dc-8e53-143282c5e57b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:48.618125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf880-cdaf-44dc-8e53-143282c5e57b None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:48.619499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 488/995] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:48.624773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141dec3-11f2-4423-88c3-931cda89b4f9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:48.625205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141dec3-11f2-4423-88c3-931cda89b4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:48.625301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141dec3-11f2-4423-88c3-931cda89b4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:48.689788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a141dec3-11f2-4423-88c3-931cda89b4f9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:48.690986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a141dec3-11f2-4423-88c3-931cda89b4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:48.782848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 508/996] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:15:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:49.071507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf880-cdaf-44dc-8e53-143282c5e57b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:15:49.073088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a39cf880-cdaf-44dc-8e53-143282c5e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:49.175408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf880-cdaf-44dc-8e53-143282c5e57b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:15:49.248651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9dd75-611e-4ce8-b2c5-12271f90c973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:15:49.249255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9dd75-611e-4ce8-b2c5-12271f90c973 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:49.249539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9dd75-611e-4ce8-b2c5-12271f90c973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:49.249812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9dd75-611e-4ce8-b2c5-12271f90c973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:49.251446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dab9dd75-611e-4ce8-b2c5-12271f90c973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:49.258225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:49.360423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9dd75-611e-4ce8-b2c5-12271f90c973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:15:49.361866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9dd75-611e-4ce8-b2c5-12271f90c973 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:15:49.379569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 489/997] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:15:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:15:52.178051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca6f5-a00d-485f-a61e-b275f9fc286e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:52.178643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca6f5-a00d-485f-a61e-b275f9fc286e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:52.178643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca6f5-a00d-485f-a61e-b275f9fc286e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:52.182060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 509/998] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:52.186553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656957-7319-43af-a360-10fe7808d3cd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:52.187254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656957-7319-43af-a360-10fe7808d3cd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:52.187441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656957-7319-43af-a360-10fe7808d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:52.259582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e9656957-7319-43af-a360-10fe7808d3cd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:52.261407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e9656957-7319-43af-a360-10fe7808d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:52.325536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:52.367676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 490/999] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:52.649570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ca6f5-a00d-485f-a61e-b275f9fc286e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:15:52.651132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-424ca6f5-a00d-485f-a61e-b275f9fc286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:52.671117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:52.756874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ca6f5-a00d-485f-a61e-b275f9fc286e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:15:52.830652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359dc1f-51ba-4ce5-95c1-122eac343fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:15:52.831296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359dc1f-51ba-4ce5-95c1-122eac343fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:52.831579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359dc1f-51ba-4ce5-95c1-122eac343fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:52.831852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359dc1f-51ba-4ce5-95c1-122eac343fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:52.833450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f359dc1f-51ba-4ce5-95c1-122eac343fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:52.907605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:52.947098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359dc1f-51ba-4ce5-95c1-122eac343fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:15:52.948553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359dc1f-51ba-4ce5-95c1-122eac343fa8 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:15:52.967282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 510/1000] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:15:55.163056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec421a-706d-4647-b1b1-85d6a2eeebbb None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:55.163634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec421a-706d-4647-b1b1-85d6a2eeebbb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:55.163634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec421a-706d-4647-b1b1-85d6a2eeebbb None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:55.167503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 491/1001] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:55.170328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a21d4-6264-46c8-9c98-f3630bfa8022 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:55.170745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a21d4-6264-46c8-9c98-f3630bfa8022 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:55.170872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a21d4-6264-46c8-9c98-f3630bfa8022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:55.249369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a44a21d4-6264-46c8-9c98-f3630bfa8022 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:55.250737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a44a21d4-6264-46c8-9c98-f3630bfa8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:55.349007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 511/1002] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:55.629311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec421a-706d-4647-b1b1-85d6a2eeebbb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:15:55.630879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d5ec421a-706d-4647-b1b1-85d6a2eeebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:55.734812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec421a-706d-4647-b1b1-85d6a2eeebbb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:15:55.809362 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92346c-cdba-479c-b3f7-30a387c193ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:15:55.809966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92346c-cdba-479c-b3f7-30a387c193ec service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:55.810240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92346c-cdba-479c-b3f7-30a387c193ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:55.810505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92346c-cdba-479c-b3f7-30a387c193ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:55.812424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ad92346c-cdba-479c-b3f7-30a387c193ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:55.829720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:55.923627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92346c-cdba-479c-b3f7-30a387c193ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:15:55.924996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92346c-cdba-479c-b3f7-30a387c193ec service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:15:55.943527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 492/1003] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:15:58.155895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7214ef-2a29-4488-952c-f6df2809789d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:58.156459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7214ef-2a29-4488-952c-f6df2809789d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:58.156459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7214ef-2a29-4488-952c-f6df2809789d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:58.157816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 512/1004] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:15:58.163276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ec23-d2a6-411b-b8da-4c945bd055bb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:58.163747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ec23-d2a6-411b-b8da-4c945bd055bb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:58.163831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ec23-d2a6-411b-b8da-4c945bd055bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:58.240936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a455ec23-d2a6-411b-b8da-4c945bd055bb None None] MFA Rules not processed for user `2a4d5aeb2b594f3aa580d835f5be6f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:15:58.242156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a455ec23-d2a6-411b-b8da-4c945bd055bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:58.309813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:58.342216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 493/1005] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:15:58.630958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7214ef-2a29-4488-952c-f6df2809789d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:15:58.632511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0b7214ef-2a29-4488-952c-f6df2809789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:58.665352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:58.741526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7214ef-2a29-4488-952c-f6df2809789d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:15:58.814524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcf8a5-7eeb-40ad-8d75-67f3ebbf58b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:15:58.815173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf8a5-7eeb-40ad-8d75-67f3ebbf58b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:15:58.815454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf8a5-7eeb-40ad-8d75-67f3ebbf58b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:15:58.815725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf8a5-7eeb-40ad-8d75-67f3ebbf58b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:15:58.817329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-23dcf8a5-7eeb-40ad-8d75-67f3ebbf58b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:15:58.895299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:58.926622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcf8a5-7eeb-40ad-8d75-67f3ebbf58b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:15:58.928029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcf8a5-7eeb-40ad-8d75-67f3ebbf58b8 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:15:58.946718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 513/1006] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:15:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:01.327219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c457d7-d9d2-4503-ad77-808439548d83 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:01.327749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c457d7-d9d2-4503-ad77-808439548d83 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:01.327749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c457d7-d9d2-4503-ad77-808439548d83 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:01.329122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 494/1007] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:01.334511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e70a-a316-4c5a-912a-048a10986119 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:01.334924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e70a-a316-4c5a-912a-048a10986119 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:01.335126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e70a-a316-4c5a-912a-048a10986119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:01.399964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a894e70a-a316-4c5a-912a-048a10986119 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:01.401708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a894e70a-a316-4c5a-912a-048a10986119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:01.495423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 514/1008] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:01.774809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c457d7-d9d2-4503-ad77-808439548d83 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:01.776991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-77c457d7-d9d2-4503-ad77-808439548d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:01.879140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c457d7-d9d2-4503-ad77-808439548d83 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:01.951791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3103e-d8a3-4d6d-a9cc-1f96755b2c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:01.952393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3103e-d8a3-4d6d-a9cc-1f96755b2c6b service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:01.952670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3103e-d8a3-4d6d-a9cc-1f96755b2c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:01.952940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3103e-d8a3-4d6d-a9cc-1f96755b2c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:01.954509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78b3103e-d8a3-4d6d-a9cc-1f96755b2c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:01.980679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:02.062817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3103e-d8a3-4d6d-a9cc-1f96755b2c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:02.064227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3103e-d8a3-4d6d-a9cc-1f96755b2c6b service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:02.082880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 495/1009] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:04.275936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5e60-ea3d-42e5-954e-f742cc419193 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:04.276444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5e60-ea3d-42e5-954e-f742cc419193 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:04.276444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5e60-ea3d-42e5-954e-f742cc419193 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:04.277777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 515/1010] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:04.282884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529595-7b25-4ca3-b600-f28ab4b2f38a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:04.283351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529595-7b25-4ca3-b600-f28ab4b2f38a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:04.283470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529595-7b25-4ca3-b600-f28ab4b2f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:04.348886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-16529595-7b25-4ca3-b600-f28ab4b2f38a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:04.350109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-16529595-7b25-4ca3-b600-f28ab4b2f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:04.426616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:04.449727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 496/1011] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:04.733315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5e60-ea3d-42e5-954e-f742cc419193 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:04.734858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d90b5e60-ea3d-42e5-954e-f742cc419193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:04.774314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:04.836751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5e60-ea3d-42e5-954e-f742cc419193 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:04.908681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca088-6580-4719-80b8-7d7bd5bbd462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:04.909279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca088-6580-4719-80b8-7d7bd5bbd462 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:04.909559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca088-6580-4719-80b8-7d7bd5bbd462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:04.909824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca088-6580-4719-80b8-7d7bd5bbd462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:04.911421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8dbca088-6580-4719-80b8-7d7bd5bbd462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:04.993182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:05.018115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca088-6580-4719-80b8-7d7bd5bbd462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:05.019572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca088-6580-4719-80b8-7d7bd5bbd462 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:05.037675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 516/1012] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:07.494807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55ca9-26d5-41e0-a996-71507d4c4126 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:07.495384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55ca9-26d5-41e0-a996-71507d4c4126 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:07.495384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55ca9-26d5-41e0-a996-71507d4c4126 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:07.496675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 497/1013] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:07.502334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7521a21-da28-422a-9278-ed067fa5cd68 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:07.502883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7521a21-da28-422a-9278-ed067fa5cd68 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:07.502883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7521a21-da28-422a-9278-ed067fa5cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:07.572007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a7521a21-da28-422a-9278-ed067fa5cd68 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:07.573738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7521a21-da28-422a-9278-ed067fa5cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:07.669561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 517/1014] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:07.952031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f55ca9-26d5-41e0-a996-71507d4c4126 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:07.953603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c6f55ca9-26d5-41e0-a996-71507d4c4126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:08.055010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f55ca9-26d5-41e0-a996-71507d4c4126 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:08.127295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7097e1f-c49a-4655-8123-a7605aa4c9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:08.127893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097e1f-c49a-4655-8123-a7605aa4c9bc service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:08.128172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097e1f-c49a-4655-8123-a7605aa4c9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:08.128441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7097e1f-c49a-4655-8123-a7605aa4c9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:08.130023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f7097e1f-c49a-4655-8123-a7605aa4c9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:08.164684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:08.238922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097e1f-c49a-4655-8123-a7605aa4c9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:08.240338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7097e1f-c49a-4655-8123-a7605aa4c9bc service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:08.258376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 498/1015] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:12.284387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65f68-d2de-43a6-8f2d-4a2e8526ebd2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:12.284957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65f68-d2de-43a6-8f2d-4a2e8526ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:12.284957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba65f68-d2de-43a6-8f2d-4a2e8526ebd2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:12.286293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 518/1016] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:12.291510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0314dd-1d27-46bb-b287-7a4353c41ae1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:12.291902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0314dd-1d27-46bb-b287-7a4353c41ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:12.292060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0314dd-1d27-46bb-b287-7a4353c41ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:12.357981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4c0314dd-1d27-46bb-b287-7a4353c41ae1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:12.359232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4c0314dd-1d27-46bb-b287-7a4353c41ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:12.445190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:12.457492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 499/1017] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:12.741790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65f68-d2de-43a6-8f2d-4a2e8526ebd2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:12.743364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2ba65f68-d2de-43a6-8f2d-4a2e8526ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:12.792660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:12.850002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba65f68-d2de-43a6-8f2d-4a2e8526ebd2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:12.921988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c402-8f4c-475d-9520-cbafc727114a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:12.922598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c402-8f4c-475d-9520-cbafc727114a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:12.922875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c402-8f4c-475d-9520-cbafc727114a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:12.923173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c402-8f4c-475d-9520-cbafc727114a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:12.924746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7016c402-8f4c-475d-9520-cbafc727114a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:13.015528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:13.032906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c402-8f4c-475d-9520-cbafc727114a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:13.034367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c402-8f4c-475d-9520-cbafc727114a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:13.052608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 519/1018] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:15.864093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01508-7690-42db-b14e-394168dff6fe None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:15.864632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01508-7690-42db-b14e-394168dff6fe None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:15.864712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01508-7690-42db-b14e-394168dff6fe None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:15.866225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 500/1019] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:15.872240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ddae2-91a9-44d3-8ccb-5a0762ea5296 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:15.872791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ddae2-91a9-44d3-8ccb-5a0762ea5296 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:15.872791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ddae2-91a9-44d3-8ccb-5a0762ea5296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:15.940056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0e5ddae2-91a9-44d3-8ccb-5a0762ea5296 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:15.941255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0e5ddae2-91a9-44d3-8ccb-5a0762ea5296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:16.036373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 520/1020] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:16.321094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf01508-7690-42db-b14e-394168dff6fe None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:16.323330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6cf01508-7690-42db-b14e-394168dff6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:16.431424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf01508-7690-42db-b14e-394168dff6fe None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:16.507418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277a3ae-3aaa-44a2-ae2d-94ea65788615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:16.507945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277a3ae-3aaa-44a2-ae2d-94ea65788615 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:16.508226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277a3ae-3aaa-44a2-ae2d-94ea65788615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:16.508498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277a3ae-3aaa-44a2-ae2d-94ea65788615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:16.510654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8277a3ae-3aaa-44a2-ae2d-94ea65788615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:16.554043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:16.624024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277a3ae-3aaa-44a2-ae2d-94ea65788615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:16.625484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277a3ae-3aaa-44a2-ae2d-94ea65788615 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:16.644952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 501/1021] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:20.758011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf6db-ecce-4969-a949-0b754bec2b70 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:20.758540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf6db-ecce-4969-a949-0b754bec2b70 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:20.758540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf6db-ecce-4969-a949-0b754bec2b70 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:20.760557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 521/1022] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:20.765814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93ac4-5f5a-427b-b20e-c6cf4bd49bfd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:20.766260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93ac4-5f5a-427b-b20e-c6cf4bd49bfd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:20.766406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93ac4-5f5a-427b-b20e-c6cf4bd49bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:20.836993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-06f93ac4-5f5a-427b-b20e-c6cf4bd49bfd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:20.838140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-06f93ac4-5f5a-427b-b20e-c6cf4bd49bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:20.934438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:20.937147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 502/1023] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:21.217122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cf6db-ecce-4969-a949-0b754bec2b70 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:21.218656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-236cf6db-ecce-4969-a949-0b754bec2b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:21.274820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:21.320628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cf6db-ecce-4969-a949-0b754bec2b70 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:21.392101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a9f84-ca81-40f2-ad9e-e4a6ae08e144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:21.392699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a9f84-ca81-40f2-ad9e-e4a6ae08e144 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:21.392972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a9f84-ca81-40f2-ad9e-e4a6ae08e144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:21.393238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a9f84-ca81-40f2-ad9e-e4a6ae08e144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:21.394808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8f0a9f84-ca81-40f2-ad9e-e4a6ae08e144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:21.498878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:21.503219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a9f84-ca81-40f2-ad9e-e4a6ae08e144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:21.504687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a9f84-ca81-40f2-ad9e-e4a6ae08e144 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:21.523316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 522/1024] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:26.418619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509fb4a-67e8-4760-acb5-52c32e2ab3f6 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:26.419116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509fb4a-67e8-4760-acb5-52c32e2ab3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:26.419218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509fb4a-67e8-4760-acb5-52c32e2ab3f6 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:26.420946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 503/1025] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:26.425873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d8a56-cbaa-490c-86d4-94b8a356695e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:26.426268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d8a56-cbaa-490c-86d4-94b8a356695e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:26.426730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d8a56-cbaa-490c-86d4-94b8a356695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:26.523172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-579d8a56-cbaa-490c-86d4-94b8a356695e None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:26.524411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-579d8a56-cbaa-490c-86d4-94b8a356695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:26.692896 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 523/1026] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:16:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:30.835661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e83d9-2f39-466e-a4ed-9382170b4d42 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:30.836233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e83d9-2f39-466e-a4ed-9382170b4d42 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:30.836233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e83d9-2f39-466e-a4ed-9382170b4d42 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:30.837740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 504/1027] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:30.842462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7fc4c-d7cf-4f6e-be02-04dbac7559a5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:30.842891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7fc4c-d7cf-4f6e-be02-04dbac7559a5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:30.843192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7fc4c-d7cf-4f6e-be02-04dbac7559a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:30.902587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:30.927604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fca7fc4c-d7cf-4f6e-be02-04dbac7559a5 None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:30.928942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fca7fc4c-d7cf-4f6e-be02-04dbac7559a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:31.038685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 524/1028] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:32.420449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a443d-4401-4976-b128-c834d78aa42c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:32.420990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a443d-4401-4976-b128-c834d78aa42c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:32.420990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a443d-4401-4976-b128-c834d78aa42c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:32.422346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 505/1029] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:32.427477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc270db-66ff-483b-bd9a-1d82691d54e7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:32.427935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc270db-66ff-483b-bd9a-1d82691d54e7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:32.428034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc270db-66ff-483b-bd9a-1d82691d54e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:32.505720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9dc270db-66ff-483b-bd9a-1d82691d54e7 None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:32.506819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9dc270db-66ff-483b-bd9a-1d82691d54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:32.548560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:32.613901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 525/1030] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:16:36.176443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084f7e-a551-4421-a5cf-ff43ab03bfe6 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:36.176990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084f7e-a551-4421-a5cf-ff43ab03bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:36.176990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47084f7e-a551-4421-a5cf-ff43ab03bfe6 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:36.178240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 506/1031] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:36.185055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a579e2-0794-4010-9e2c-a9d65c4ece79 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:36.186440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a579e2-0794-4010-9e2c-a9d65c4ece79 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:36.186721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a579e2-0794-4010-9e2c-a9d65c4ece79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:36.257497 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e4a579e2-0794-4010-9e2c-a9d65c4ece79 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:36.258613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e4a579e2-0794-4010-9e2c-a9d65c4ece79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:36.360398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 526/1032] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:36.661617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18dea9-0820-4842-b16b-011bb88c9a1f None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:36.662107 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18dea9-0820-4842-b16b-011bb88c9a1f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:36.662545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18dea9-0820-4842-b16b-011bb88c9a1f None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:36.664128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 507/1033] 10.222.0.46 () {54 vars in 961 bytes} [Wed Oct 19 13:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:36.673189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b007-e5e6-41a0-b922-705902cacaac None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:36.673678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b007-e5e6-41a0-b922-705902cacaac None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:36.674110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b007-e5e6-41a0-b922-705902cacaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:36.693689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:36.761428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fdf9b007-e5e6-41a0-b922-705902cacaac None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:36.762776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fdf9b007-e5e6-41a0-b922-705902cacaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:36.887588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 527/1034] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Oct 19 13:16:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:36.895344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18dea9-0820-4842-b16b-011bb88c9a1f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:36.896901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6d18dea9-0820-4842-b16b-011bb88c9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:37.059706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18dea9-0820-4842-b16b-011bb88c9a1f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:37.139983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:37.189926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf61906-57a9-4e88-a265-033bb7c5ba29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:37.190595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf61906-57a9-4e88-a265-033bb7c5ba29 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:37.190802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf61906-57a9-4e88-a265-033bb7c5ba29 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:37.191068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf61906-57a9-4e88-a265-033bb7c5ba29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:37.192672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eaf61906-57a9-4e88-a265-033bb7c5ba29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:37.294108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf61906-57a9-4e88-a265-033bb7c5ba29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:37.297209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf61906-57a9-4e88-a265-033bb7c5ba29 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:37.316555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 508/1035] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:39.694489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff22282-7b74-40ed-9522-f1a99dd1ca6d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:39.695126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff22282-7b74-40ed-9522-f1a99dd1ca6d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:39.695126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff22282-7b74-40ed-9522-f1a99dd1ca6d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:39.696578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 528/1036] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:39.701865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91dcd0-5032-4964-bb19-1bc78bf05c2f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:39.702312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91dcd0-5032-4964-bb19-1bc78bf05c2f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:39.702438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91dcd0-5032-4964-bb19-1bc78bf05c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:39.804187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1b91dcd0-5032-4964-bb19-1bc78bf05c2f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:39.805596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1b91dcd0-5032-4964-bb19-1bc78bf05c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:39.849499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:39.915120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 509/1037] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:40.210279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff22282-7b74-40ed-9522-f1a99dd1ca6d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:40.212369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5ff22282-7b74-40ed-9522-f1a99dd1ca6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:40.285617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:40.406400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff22282-7b74-40ed-9522-f1a99dd1ca6d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:40.537779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cdb4f-2352-4eb9-ae8e-02e4ea69eca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:40.538397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdb4f-2352-4eb9-ae8e-02e4ea69eca4 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:40.538680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdb4f-2352-4eb9-ae8e-02e4ea69eca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:40.538958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdb4f-2352-4eb9-ae8e-02e4ea69eca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:40.541222 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8f2cdb4f-2352-4eb9-ae8e-02e4ea69eca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:40.564396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:40.633484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cdb4f-2352-4eb9-ae8e-02e4ea69eca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:40.635672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cdb4f-2352-4eb9-ae8e-02e4ea69eca4 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:40.654163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 529/1038] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:43.158433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9c58-5933-4520-819b-7a5c45caf0dd None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:43.158956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9c58-5933-4520-819b-7a5c45caf0dd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:43.158956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9c58-5933-4520-819b-7a5c45caf0dd None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:43.160450 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 510/1039] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:43.168377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4dfa-61ca-4127-a531-63cece1cbb65 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:43.168377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4dfa-61ca-4127-a531-63cece1cbb65 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:43.168377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4dfa-61ca-4127-a531-63cece1cbb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:43.235319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-79ec4dfa-61ca-4127-a531-63cece1cbb65 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:43.236542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-79ec4dfa-61ca-4127-a531-63cece1cbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:43.341524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:43.343951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 530/1040] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:43.630557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967473-bde5-4d2a-b431-6b2ace2f0656 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:43.630917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967473-bde5-4d2a-b431-6b2ace2f0656 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:43.631304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967473-bde5-4d2a-b431-6b2ace2f0656 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:43.632768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 511/1041] 10.222.0.46 () {54 vars in 961 bytes} [Wed Oct 19 13:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:43.638893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147aaef-73c3-49f4-bbd6-d20dd909a4b9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:43.639275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147aaef-73c3-49f4-bbd6-d20dd909a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:43.639624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147aaef-73c3-49f4-bbd6-d20dd909a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:43.719589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3147aaef-73c3-49f4-bbd6-d20dd909a4b9 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:43.720932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3147aaef-73c3-49f4-bbd6-d20dd909a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:43.840634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 531/1042] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Oct 19 13:16:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:43.848424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27967473-bde5-4d2a-b431-6b2ace2f0656 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:43.849958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-27967473-bde5-4d2a-b431-6b2ace2f0656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:44.006178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27967473-bde5-4d2a-b431-6b2ace2f0656 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:44.027183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:44.142831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c037-53f8-4446-aa17-0a47bca3e847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:44.143471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c037-53f8-4446-aa17-0a47bca3e847 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:44.143750 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c037-53f8-4446-aa17-0a47bca3e847 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:44.144019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c037-53f8-4446-aa17-0a47bca3e847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:44.145624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-73d0c037-53f8-4446-aa17-0a47bca3e847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:44.256067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c037-53f8-4446-aa17-0a47bca3e847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:44.257719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c037-53f8-4446-aa17-0a47bca3e847 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:44.277982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 512/1043] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:44.327040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5e3d-df53-4929-8d12-14a80499572f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:44.327547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5e3d-df53-4929-8d12-14a80499572f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:44.327547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5e3d-df53-4929-8d12-14a80499572f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:44.335402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 532/1044] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:44.335506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11043940-8316-4d2d-8c9f-70284f59eae0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:44.335506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11043940-8316-4d2d-8c9f-70284f59eae0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:44.335506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11043940-8316-4d2d-8c9f-70284f59eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:44.374219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:44.422492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-11043940-8316-4d2d-8c9f-70284f59eae0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:44.423769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-11043940-8316-4d2d-8c9f-70284f59eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:44.549448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 513/1045] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:44.880394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f17e1-937e-40af-807f-9278a001bb37 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:44.886035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f17e1-937e-40af-807f-9278a001bb37 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:44.886035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f17e1-937e-40af-807f-9278a001bb37 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:44.886035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 533/1046] 10.222.0.46 () {54 vars in 963 bytes} [Wed Oct 19 13:16:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:44.890638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e84c0f-e7de-4d8a-92c7-8a60790ddb0a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:44.890923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e84c0f-e7de-4d8a-92c7-8a60790ddb0a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:44.891232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e84c0f-e7de-4d8a-92c7-8a60790ddb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:44.971321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c4e84c0f-e7de-4d8a-92c7-8a60790ddb0a None None] MFA Rules not processed for user `908ecd4f59ba49e7bec2a57700bdf957`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:44.972530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c4e84c0f-e7de-4d8a-92c7-8a60790ddb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:45.022531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:45.056287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 514/1047] 10.222.0.46 () {58 vars in 1060 bytes} [Wed Oct 19 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:45.064227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f17e1-937e-40af-807f-9278a001bb37 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:45.065742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-360f17e1-937e-40af-807f-9278a001bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:45.121321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:45.182780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f17e1-937e-40af-807f-9278a001bb37 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:45.274552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113662d-967e-4526-9e86-99cb0330f183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:45.275315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113662d-967e-4526-9e86-99cb0330f183 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:45.275472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113662d-967e-4526-9e86-99cb0330f183 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:45.275743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113662d-967e-4526-9e86-99cb0330f183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:45.277778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9113662d-967e-4526-9e86-99cb0330f183 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:45.400197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:45.419060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113662d-967e-4526-9e86-99cb0330f183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:45.421094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113662d-967e-4526-9e86-99cb0330f183 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:45.447615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 534/1048] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:16:46.519218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab21bec-8a01-4f9f-9509-f4569603a19c None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:46.519788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab21bec-8a01-4f9f-9509-f4569603a19c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:46.519788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab21bec-8a01-4f9f-9509-f4569603a19c None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:46.525700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 515/1049] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:46.527577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f2a7-f5a2-4350-b8a1-6a238726bcc0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:46.528007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f2a7-f5a2-4350-b8a1-6a238726bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:46.528251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f2a7-f5a2-4350-b8a1-6a238726bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:46.596021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d634f2a7-f5a2-4350-b8a1-6a238726bcc0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:46.597307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d634f2a7-f5a2-4350-b8a1-6a238726bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:46.692928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 535/1050] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:46.984864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab21bec-8a01-4f9f-9509-f4569603a19c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:46.986508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7ab21bec-8a01-4f9f-9509-f4569603a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:47.145830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab21bec-8a01-4f9f-9509-f4569603a19c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:47.202883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:47.266624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a0a48-c405-499e-acd3-f5b74755d53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:47.267277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0a48-c405-499e-acd3-f5b74755d53a service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:47.267559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0a48-c405-499e-acd3-f5b74755d53a service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:47.267831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a0a48-c405-499e-acd3-f5b74755d53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:47.269616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3b9a0a48-c405-499e-acd3-f5b74755d53a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:47.367256 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a0a48-c405-499e-acd3-f5b74755d53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:47.369442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a0a48-c405-499e-acd3-f5b74755d53a service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:47.388716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 516/1051] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:49.599371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182315-e568-4ea0-8217-c3839114a2f5 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:49.599921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182315-e568-4ea0-8217-c3839114a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:49.599921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182315-e568-4ea0-8217-c3839114a2f5 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:49.601283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 536/1052] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:49.606705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676110c-ced0-4729-bd48-6d2521b5b462 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:49.607149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676110c-ced0-4729-bd48-6d2521b5b462 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:49.607328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676110c-ced0-4729-bd48-6d2521b5b462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:49.675501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0676110c-ced0-4729-bd48-6d2521b5b462 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:49.676686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0676110c-ced0-4729-bd48-6d2521b5b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:49.683847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:49.784828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 517/1053] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:50.073200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182315-e568-4ea0-8217-c3839114a2f5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:50.074996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-52182315-e568-4ea0-8217-c3839114a2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:50.138345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:50.237008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182315-e568-4ea0-8217-c3839114a2f5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:50.356216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f37d3-559e-40fa-b796-ce83c819f209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:50.356836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f37d3-559e-40fa-b796-ce83c819f209 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:50.357120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f37d3-559e-40fa-b796-ce83c819f209 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:50.357394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f37d3-559e-40fa-b796-ce83c819f209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:50.358980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7e0f37d3-559e-40fa-b796-ce83c819f209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:50.379119 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:50.457014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f37d3-559e-40fa-b796-ce83c819f209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:50.458616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f37d3-559e-40fa-b796-ce83c819f209 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:50.477790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 537/1054] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:52.672542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22052f-113d-4644-a808-b8f41a7629c0 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:52.673114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22052f-113d-4644-a808-b8f41a7629c0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:52.673114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22052f-113d-4644-a808-b8f41a7629c0 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:52.674647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 518/1055] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:52.679708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54878-14e6-4d51-88bf-c9db7fb355a9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:52.680121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54878-14e6-4d51-88bf-c9db7fb355a9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:52.680294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54878-14e6-4d51-88bf-c9db7fb355a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:52.751490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-13b54878-14e6-4d51-88bf-c9db7fb355a9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:52.752869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-13b54878-14e6-4d51-88bf-c9db7fb355a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:52.894897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:52.906146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 538/1056] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:53.196983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22052f-113d-4644-a808-b8f41a7629c0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:53.198516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cc22052f-113d-4644-a808-b8f41a7629c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:53.352621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:53.365418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22052f-113d-4644-a808-b8f41a7629c0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:53.485158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c245a-9f4a-4f5b-abea-6650b692b59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:53.485682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c245a-9f4a-4f5b-abea-6650b692b59b service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:53.485958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c245a-9f4a-4f5b-abea-6650b692b59b service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:53.486225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c245a-9f4a-4f5b-abea-6650b692b59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:53.487850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-161c245a-9f4a-4f5b-abea-6650b692b59b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:53.583141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c245a-9f4a-4f5b-abea-6650b692b59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:53.584775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c245a-9f4a-4f5b-abea-6650b692b59b service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:53.595486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:53.604669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 519/1057] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:55.879727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629adb-6a5d-4da1-bf90-0153af8b812d None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:55.880271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629adb-6a5d-4da1-bf90-0153af8b812d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:55.880271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39629adb-6a5d-4da1-bf90-0153af8b812d None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:55.881550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 539/1058] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:16:55.887557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005399-f515-4c1e-9f53-3cd621333e22 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:55.888002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005399-f515-4c1e-9f53-3cd621333e22 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:55.888106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005399-f515-4c1e-9f53-3cd621333e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:55.955685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-21005399-f515-4c1e-9f53-3cd621333e22 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:55.957012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-21005399-f515-4c1e-9f53-3cd621333e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:56.075067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 520/1059] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:56.362007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39629adb-6a5d-4da1-bf90-0153af8b812d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:56.363706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-39629adb-6a5d-4da1-bf90-0153af8b812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:56.530078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39629adb-6a5d-4da1-bf90-0153af8b812d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:56.605343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:56.654655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c1b0-3a9a-446b-a382-75dfb4a5c755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:56.655313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c1b0-3a9a-446b-a382-75dfb4a5c755 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:56.655597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c1b0-3a9a-446b-a382-75dfb4a5c755 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:56.655869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c1b0-3a9a-446b-a382-75dfb4a5c755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:56.657483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8116c1b0-3a9a-446b-a382-75dfb4a5c755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:56.753907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c1b0-3a9a-446b-a382-75dfb4a5c755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:56.755642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c1b0-3a9a-446b-a382-75dfb4a5c755 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:56.774157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 540/1060] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:16:59.116550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8158d0-a52a-4f1c-8600-38bc2f7a1baf None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:59.117606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8158d0-a52a-4f1c-8600-38bc2f7a1baf None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:59.117726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8158d0-a52a-4f1c-8600-38bc2f7a1baf None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:59.119019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 521/1061] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:16:59.124207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0157e-e042-46c0-bcdf-e6e60952bd2f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:59.124650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0157e-e042-46c0-bcdf-e6e60952bd2f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:59.124742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0157e-e042-46c0-bcdf-e6e60952bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:59.192973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-dad0157e-e042-46c0-bcdf-e6e60952bd2f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:16:59.194204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dad0157e-e042-46c0-bcdf-e6e60952bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:59.226970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:59.289892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 541/1062] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:16:59.579679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8158d0-a52a-4f1c-8600-38bc2f7a1baf None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:16:59.581205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8f8158d0-a52a-4f1c-8600-38bc2f7a1baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:59.657612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:59.729802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8158d0-a52a-4f1c-8600-38bc2f7a1baf None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:16:59.844766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a11ae-a7b0-432d-967a-d71f287705bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:16:59.845375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a11ae-a7b0-432d-967a-d71f287705bc service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:16:59.845656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a11ae-a7b0-432d-967a-d71f287705bc service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:16:59.845931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a11ae-a7b0-432d-967a-d71f287705bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:16:59.847586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-617a11ae-a7b0-432d-967a-d71f287705bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:16:59.887933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:59.941229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a11ae-a7b0-432d-967a-d71f287705bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:16:59.942835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a11ae-a7b0-432d-967a-d71f287705bc service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:16:59.961482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 522/1063] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:00.815752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0f776-2a73-46cd-bd64-31eac54de4be None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:00.816420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0f776-2a73-46cd-bd64-31eac54de4be None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:00.816420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0f776-2a73-46cd-bd64-31eac54de4be None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:00.817797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 542/1064] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:00.823476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18db67a-f590-44a4-9a84-0a9a34e6cc2e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:00.823911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18db67a-f590-44a4-9a84-0a9a34e6cc2e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:00.824033 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18db67a-f590-44a4-9a84-0a9a34e6cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:00.900459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c18db67a-f590-44a4-9a84-0a9a34e6cc2e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:00.901669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c18db67a-f590-44a4-9a84-0a9a34e6cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:00.997147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 523/1065] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:01.297226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845d75-88cd-45d3-b730-a9aeb49c274f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:01.297518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845d75-88cd-45d3-b730-a9aeb49c274f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:01.297802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845d75-88cd-45d3-b730-a9aeb49c274f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:01.299410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 543/1066] 10.222.0.46 () {54 vars in 962 bytes} [Wed Oct 19 13:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:01.305461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca686611-cc57-44f7-9505-a8073d57f4ce None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:01.305691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca686611-cc57-44f7-9505-a8073d57f4ce None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:01.305972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca686611-cc57-44f7-9505-a8073d57f4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:01.325009 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:01.384169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ca686611-cc57-44f7-9505-a8073d57f4ce None None] MFA Rules not processed for user `997c5e419c4045f4b8db4f6c1865d18b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:01.385367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ca686611-cc57-44f7-9505-a8073d57f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:01.462416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 524/1067] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Oct 19 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:01.471376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845d75-88cd-45d3-b730-a9aeb49c274f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:01.472885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-28845d75-88cd-45d3-b730-a9aeb49c274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:01.578657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845d75-88cd-45d3-b730-a9aeb49c274f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:01.637737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:01.653531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a67a9e-5f42-4d3a-8273-499497f7139e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:01.654142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a67a9e-5f42-4d3a-8273-499497f7139e service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:01.654423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a67a9e-5f42-4d3a-8273-499497f7139e service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:01.654694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a67a9e-5f42-4d3a-8273-499497f7139e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:01.656310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-03a67a9e-5f42-4d3a-8273-499497f7139e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:01.767822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a67a9e-5f42-4d3a-8273-499497f7139e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:01.769197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a67a9e-5f42-4d3a-8273-499497f7139e service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:01.788532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 544/1068] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:02.152836 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb7e04-24c6-4b75-8380-29c4b58486f7 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:02.153419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb7e04-24c6-4b75-8380-29c4b58486f7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:02.153419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb7e04-24c6-4b75-8380-29c4b58486f7 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:02.154721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 525/1069] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:02.160174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:02.160588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:02.160790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:02.241209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:02.243205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:02.286426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:02.345120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 545/1070] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:02.534574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3e70-a837-4c6d-88b5-f534265995cc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:02.534959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3e70-a837-4c6d-88b5-f534265995cc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:02.535322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3e70-a837-4c6d-88b5-f534265995cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:02.602699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4d2b3e70-a837-4c6d-88b5-f534265995cc None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:02.603921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4d2b3e70-a837-4c6d-88b5-f534265995cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:02.638160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:02.639392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:02.660743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:02.694894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 526/1071] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:02.738059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11acdfe-8fe6-4a58-b7d9-2fe5ab790215 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:02.738345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11acdfe-8fe6-4a58-b7d9-2fe5ab790215 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:02.738618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11acdfe-8fe6-4a58-b7d9-2fe5ab790215 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:02.740002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 527/1072] 10.222.0.46 () {54 vars in 943 bytes} [Wed Oct 19 13:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:17:02.746950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4f14-cf16-471c-b22b-868d3b7bda32 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:02.747287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4f14-cf16-471c-b22b-868d3b7bda32 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:02.747563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4f14-cf16-471c-b22b-868d3b7bda32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:02.759958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e951e-b811-402f-88cb-0309c8abc82b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:02.816324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:02.825446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-21ee4f14-cf16-471c-b22b-868d3b7bda32 None None] MFA Rules not processed for user `2d5405a020ae4d61810ae01872cf325b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:02.826660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-21ee4f14-cf16-471c-b22b-868d3b7bda32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:02.874853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4fa4-353f-4cf9-ab12-8b9db921ea3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:02.875486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4fa4-353f-4cf9-ab12-8b9db921ea3b service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:02.875767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4fa4-353f-4cf9-ab12-8b9db921ea3b service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:02.876039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4fa4-353f-4cf9-ab12-8b9db921ea3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:02.877629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d58e4fa4-353f-4cf9-ab12-8b9db921ea3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:02.938303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 528/1073] 10.222.0.46 () {58 vars in 1040 bytes} [Wed Oct 19 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:17:02.948863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4f14-cf16-471c-b22b-868d3b7bda32 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:02.958403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4f14-cf16-471c-b22b-868d3b7bda32 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:02.969302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4fa4-353f-4cf9-ab12-8b9db921ea3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:02.970833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4fa4-353f-4cf9-ab12-8b9db921ea3b service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:02.984106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:02.989377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 546/1074] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:17:03.066760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879f342-ee38-4079-bb5e-a61ebc6ba55a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:03.067439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f342-ee38-4079-bb5e-a61ebc6ba55a service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:03.067721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f342-ee38-4079-bb5e-a61ebc6ba55a service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:03.067984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f342-ee38-4079-bb5e-a61ebc6ba55a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:03.069719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d879f342-ee38-4079-bb5e-a61ebc6ba55a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:03.163364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879f342-ee38-4079-bb5e-a61ebc6ba55a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:03.166014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879f342-ee38-4079-bb5e-a61ebc6ba55a service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:03.175035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 529/1075] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 19 13:17:05.202362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737cb33-2e1e-4577-a801-ee048636f64f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:05.203480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737cb33-2e1e-4577-a801-ee048636f64f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:05.203829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737cb33-2e1e-4577-a801-ee048636f64f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:05.205271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 547/1076] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:05.211201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e563d-7321-4e8c-a6cb-93aa4ad0bca2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:05.211995 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e563d-7321-4e8c-a6cb-93aa4ad0bca2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:05.212273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e563d-7321-4e8c-a6cb-93aa4ad0bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:05.291329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-560e563d-7321-4e8c-a6cb-93aa4ad0bca2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:05.292867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-560e563d-7321-4e8c-a6cb-93aa4ad0bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:05.302948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:05.409006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 530/1077] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:05.698704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737cb33-2e1e-4577-a801-ee048636f64f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:05.700345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f737cb33-2e1e-4577-a801-ee048636f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:05.776783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:05.886387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737cb33-2e1e-4577-a801-ee048636f64f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:06.062694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c36189-3ce1-477e-aa70-fb889fa88940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:06.063345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c36189-3ce1-477e-aa70-fb889fa88940 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:06.063623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c36189-3ce1-477e-aa70-fb889fa88940 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:06.063898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c36189-3ce1-477e-aa70-fb889fa88940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:06.065543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-19c36189-3ce1-477e-aa70-fb889fa88940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:06.097352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:06.168385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c36189-3ce1-477e-aa70-fb889fa88940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:06.170083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c36189-3ce1-477e-aa70-fb889fa88940 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:06.192307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 548/1078] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:08.404130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99ca86-80b3-426c-a4c8-fedbadd71fb4 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:08.404672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99ca86-80b3-426c-a4c8-fedbadd71fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:08.404672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99ca86-80b3-426c-a4c8-fedbadd71fb4 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:08.406178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 531/1079] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:08.411233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035786e7-5192-42a5-855b-8ff0c3719416 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:08.411635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035786e7-5192-42a5-855b-8ff0c3719416 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:08.411824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035786e7-5192-42a5-855b-8ff0c3719416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:08.487596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-035786e7-5192-42a5-855b-8ff0c3719416 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:08.488833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-035786e7-5192-42a5-855b-8ff0c3719416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:08.599820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 549/1080] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:08.893274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99ca86-80b3-426c-a4c8-fedbadd71fb4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:08.894983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bc99ca86-80b3-426c-a4c8-fedbadd71fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:09.044004 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:09.054830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99ca86-80b3-426c-a4c8-fedbadd71fb4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:09.181342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5a98-756d-41ce-8c95-410f89130a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:09.182433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5a98-756d-41ce-8c95-410f89130a09 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:09.182716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5a98-756d-41ce-8c95-410f89130a09 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:09.183911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5a98-756d-41ce-8c95-410f89130a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:09.187910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-529d5a98-756d-41ce-8c95-410f89130a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:09.282825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5a98-756d-41ce-8c95-410f89130a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:09.284590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5a98-756d-41ce-8c95-410f89130a09 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:09.297293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:09.308669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 532/1081] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:11.517470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de45e8-0c7b-421d-833b-ec09598684aa None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:11.517988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de45e8-0c7b-421d-833b-ec09598684aa None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:11.517988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de45e8-0c7b-421d-833b-ec09598684aa None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:11.519335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 550/1082] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:11.524811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3f32-e3f4-40e5-8293-6fae5c1ad849 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:11.525230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3f32-e3f4-40e5-8293-6fae5c1ad849 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:11.525380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3f32-e3f4-40e5-8293-6fae5c1ad849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:11.595845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-31fe3f32-e3f4-40e5-8293-6fae5c1ad849 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:11.597097 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-31fe3f32-e3f4-40e5-8293-6fae5c1ad849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:11.709375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 533/1083] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:11.999161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de45e8-0c7b-421d-833b-ec09598684aa None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:12.000674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b6de45e8-0c7b-421d-833b-ec09598684aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:12.003598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:12.170456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de45e8-0c7b-421d-833b-ec09598684aa None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:12.256144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:12.300469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c618f4e-6b11-48fd-a902-f4434b54f861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:12.301429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618f4e-6b11-48fd-a902-f4434b54f861 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:12.301704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618f4e-6b11-48fd-a902-f4434b54f861 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:12.301984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618f4e-6b11-48fd-a902-f4434b54f861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:12.303675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2c618f4e-6b11-48fd-a902-f4434b54f861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:12.406763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c618f4e-6b11-48fd-a902-f4434b54f861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:12.408699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c618f4e-6b11-48fd-a902-f4434b54f861 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:12.429735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 551/1084] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:21.707357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=67 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:22.426661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=61 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:26.098171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802362c3-77f9-47f5-8a35-58dfc905f697 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:26.098742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802362c3-77f9-47f5-8a35-58dfc905f697 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:26.098742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802362c3-77f9-47f5-8a35-58dfc905f697 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:26.100898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 534/1085] 10.222.0.46 () {54 vars in 918 bytes} [Wed Oct 19 13:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:26.106057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986982-a365-4ee7-b5fe-26c8cd1bfb8a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:26.106489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986982-a365-4ee7-b5fe-26c8cd1bfb8a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:26.106612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986982-a365-4ee7-b5fe-26c8cd1bfb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:26.181055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d2986982-a365-4ee7-b5fe-26c8cd1bfb8a None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:26.182261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d2986982-a365-4ee7-b5fe-26c8cd1bfb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:26.286776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 552/1086] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Oct 19 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:17:26.301623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9061a-0be8-4f22-a981-f017649b8366 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:26.301919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9061a-0be8-4f22-a981-f017649b8366 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:26.302198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9061a-0be8-4f22-a981-f017649b8366 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:26.303615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 535/1087] 10.222.0.46 () {54 vars in 918 bytes} [Wed Oct 19 13:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:26.308006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebf8e-6d6f-47e8-9896-1551b0f472a4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:26.308298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebf8e-6d6f-47e8-9896-1551b0f472a4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:26.308575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eebf8e-6d6f-47e8-9896-1551b0f472a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:26.380036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:26.383650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-28eebf8e-6d6f-47e8-9896-1551b0f472a4 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:26.385527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-28eebf8e-6d6f-47e8-9896-1551b0f472a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:26.498038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 553/1088] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Oct 19 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:17:29.042250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1ce9-b762-49d6-9cb5-4410aeb5a5a2 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:29.042840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1ce9-b762-49d6-9cb5-4410aeb5a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:29.042840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b1ce9-b762-49d6-9cb5-4410aeb5a5a2 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:29.044240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 536/1089] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:29.049606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab2cd-8c55-4765-8703-502d55ae48f4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:29.050030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab2cd-8c55-4765-8703-502d55ae48f4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:29.050145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab2cd-8c55-4765-8703-502d55ae48f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:29.115229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-166ab2cd-8c55-4765-8703-502d55ae48f4 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:29.116918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-166ab2cd-8c55-4765-8703-502d55ae48f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:29.170573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:29.213684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 554/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:29.504457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1ce9-b762-49d6-9cb5-4410aeb5a5a2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:29.506084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f57b1ce9-b762-49d6-9cb5-4410aeb5a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:29.650775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b1ce9-b762-49d6-9cb5-4410aeb5a5a2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:29.721990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:29.761515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13014a6-83a6-4499-bad2-45491bce9831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:29.762073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13014a6-83a6-4499-bad2-45491bce9831 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:29.762351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13014a6-83a6-4499-bad2-45491bce9831 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:29.762618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13014a6-83a6-4499-bad2-45491bce9831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:29.764239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b13014a6-83a6-4499-bad2-45491bce9831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:29.852469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13014a6-83a6-4499-bad2-45491bce9831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:29.854055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13014a6-83a6-4499-bad2-45491bce9831 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:29.871510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 537/1091] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:31.000529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba40e-7b46-4422-81e9-045a4279cd38 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:31.001083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba40e-7b46-4422-81e9-045a4279cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:31.001083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba40e-7b46-4422-81e9-045a4279cd38 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:31.002470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 555/1092] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:31.008932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa47c-a10a-457f-807e-6dd9629f0f88 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:31.009390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa47c-a10a-457f-807e-6dd9629f0f88 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:31.009484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa47c-a10a-457f-807e-6dd9629f0f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:31.084233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-eecaa47c-a10a-457f-807e-6dd9629f0f88 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:31.085446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eecaa47c-a10a-457f-807e-6dd9629f0f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:31.111922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:31.181060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 538/1093] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:31.329713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba40e-7b46-4422-81e9-045a4279cd38 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:31.331218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-900ba40e-7b46-4422-81e9-045a4279cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:31.476269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba40e-7b46-4422-81e9-045a4279cd38 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:31.514878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:31.587945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b8ac0-c034-4d74-86b8-f35add781584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:31.588553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8ac0-c034-4d74-86b8-f35add781584 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:31.588833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8ac0-c034-4d74-86b8-f35add781584 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:31.589109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8ac0-c034-4d74-86b8-f35add781584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:31.590693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9e9b8ac0-c034-4d74-86b8-f35add781584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:31.678849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8ac0-c034-4d74-86b8-f35add781584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:31.680464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8ac0-c034-4d74-86b8-f35add781584 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:31.698525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 556/1094] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:32.831853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648809b-94ea-4afa-80e9-174b75a3deab None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:32.832454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648809b-94ea-4afa-80e9-174b75a3deab None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:32.832454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648809b-94ea-4afa-80e9-174b75a3deab None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:32.833805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 539/1095] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:32.840542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62350-7769-4a56-9542-0db23d6c9fb2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:32.841037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62350-7769-4a56-9542-0db23d6c9fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:32.841145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62350-7769-4a56-9542-0db23d6c9fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:32.893684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:32.917282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f8f62350-7769-4a56-9542-0db23d6c9fb2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:32.918503 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f8f62350-7769-4a56-9542-0db23d6c9fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:33.013710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 557/1096] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:33.165445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648809b-94ea-4afa-80e9-174b75a3deab None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:33.166896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2648809b-94ea-4afa-80e9-174b75a3deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:33.311804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648809b-94ea-4afa-80e9-174b75a3deab None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:33.323690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:33.422611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cf1f1-64f5-4ab0-b2fe-652dade8b876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:33.423165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cf1f1-64f5-4ab0-b2fe-652dade8b876 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:33.423443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cf1f1-64f5-4ab0-b2fe-652dade8b876 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:33.423712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cf1f1-64f5-4ab0-b2fe-652dade8b876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:33.425299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-264cf1f1-64f5-4ab0-b2fe-652dade8b876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:33.513109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cf1f1-64f5-4ab0-b2fe-652dade8b876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:33.514696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cf1f1-64f5-4ab0-b2fe-652dade8b876 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:33.532812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 540/1097] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:34.647126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086ea1-e3cd-4eed-8a12-90f359895239 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:34.647724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086ea1-e3cd-4eed-8a12-90f359895239 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:34.647724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086ea1-e3cd-4eed-8a12-90f359895239 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:34.649040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 558/1098] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:34.655272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f657-ceac-4ac9-bdbb-0d12a70232eb None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:34.655729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f657-ceac-4ac9-bdbb-0d12a70232eb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:34.655838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f657-ceac-4ac9-bdbb-0d12a70232eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:34.675756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:34.732075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-90b5f657-ceac-4ac9-bdbb-0d12a70232eb None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:34.733281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-90b5f657-ceac-4ac9-bdbb-0d12a70232eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:34.828741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 541/1099] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:34.978423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d086ea1-e3cd-4eed-8a12-90f359895239 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:34.979895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6d086ea1-e3cd-4eed-8a12-90f359895239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:35.088794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:35.124826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d086ea1-e3cd-4eed-8a12-90f359895239 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:35.234702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e08f8-b3dc-4217-a2bb-c3362635bb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:35.235273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e08f8-b3dc-4217-a2bb-c3362635bb0e service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:35.235551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e08f8-b3dc-4217-a2bb-c3362635bb0e service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:35.235850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e08f8-b3dc-4217-a2bb-c3362635bb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:35.237460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2b4e08f8-b3dc-4217-a2bb-c3362635bb0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:35.315597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:35.329656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e08f8-b3dc-4217-a2bb-c3362635bb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:35.331286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e08f8-b3dc-4217-a2bb-c3362635bb0e service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:35.349419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 559/1100] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:36.458786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499baa-210c-4fa6-b2ab-d6a8fe3c1250 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:36.459893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499baa-210c-4fa6-b2ab-d6a8fe3c1250 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:36.459893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499baa-210c-4fa6-b2ab-d6a8fe3c1250 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:36.461265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 542/1101] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:36.467614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32768378-7722-4f45-a05d-3da3a769d0af None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:36.468079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32768378-7722-4f45-a05d-3da3a769d0af None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:36.468176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32768378-7722-4f45-a05d-3da3a769d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:36.544247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-32768378-7722-4f45-a05d-3da3a769d0af None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:36.545470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-32768378-7722-4f45-a05d-3da3a769d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:36.642639 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 560/1102] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:36.795196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499baa-210c-4fa6-b2ab-d6a8fe3c1250 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:36.796626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1b499baa-210c-4fa6-b2ab-d6a8fe3c1250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:36.882451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:36.943894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499baa-210c-4fa6-b2ab-d6a8fe3c1250 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:37.055403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3ea0-8dc8-454d-8618-cdb78f3d6d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:37.056010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3ea0-8dc8-454d-8618-cdb78f3d6d9f service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:37.056292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3ea0-8dc8-454d-8618-cdb78f3d6d9f service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:37.056565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3ea0-8dc8-454d-8618-cdb78f3d6d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:37.058170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7f0a3ea0-8dc8-454d-8618-cdb78f3d6d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:37.106578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:37.147618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3ea0-8dc8-454d-8618-cdb78f3d6d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:37.149214 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3ea0-8dc8-454d-8618-cdb78f3d6d9f service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:37.167407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 543/1103] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:38.219341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffdee-f034-41b8-8c5b-6ecd2cf69b25 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:38.219793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffdee-f034-41b8-8c5b-6ecd2cf69b25 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:38.219893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ffdee-f034-41b8-8c5b-6ecd2cf69b25 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:38.221255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 561/1104] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:38.227454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b6d9a-15a3-436a-a8dd-1691922ef09b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:38.227897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b6d9a-15a3-436a-a8dd-1691922ef09b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:38.228005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b6d9a-15a3-436a-a8dd-1691922ef09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:38.303697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-051b6d9a-15a3-436a-a8dd-1691922ef09b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:38.304827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-051b6d9a-15a3-436a-a8dd-1691922ef09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:38.401379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 544/1105] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:38.551868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ffdee-f034-41b8-8c5b-6ecd2cf69b25 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:38.554099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ff3ffdee-f034-41b8-8c5b-6ecd2cf69b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:38.602302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:38.700290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ffdee-f034-41b8-8c5b-6ecd2cf69b25 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:38.810907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664e23-027b-4a57-9db2-865a6d822d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:38.811467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664e23-027b-4a57-9db2-865a6d822d04 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:38.811745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664e23-027b-4a57-9db2-865a6d822d04 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:38.812011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664e23-027b-4a57-9db2-865a6d822d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:38.813589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-77664e23-027b-4a57-9db2-865a6d822d04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:38.820326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:38.902625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664e23-027b-4a57-9db2-865a6d822d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:38.904241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664e23-027b-4a57-9db2-865a6d822d04 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:38.922524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 562/1106] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:39.968308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edac77-a75e-4f23-8326-10bacd5c6339 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:39.968874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edac77-a75e-4f23-8326-10bacd5c6339 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:39.968874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edac77-a75e-4f23-8326-10bacd5c6339 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:39.970267 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 545/1107] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:39.977085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1c33-68bb-4ffc-aef4-1925117c0b3c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:39.977526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1c33-68bb-4ffc-aef4-1925117c0b3c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:39.977621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1c33-68bb-4ffc-aef4-1925117c0b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:40.053520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-377b1c33-68bb-4ffc-aef4-1925117c0b3c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:40.054737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-377b1c33-68bb-4ffc-aef4-1925117c0b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:40.122430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:40.150782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 563/1108] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:40.302658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edac77-a75e-4f23-8326-10bacd5c6339 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:40.304183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d4edac77-a75e-4f23-8326-10bacd5c6339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:40.322567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:40.454322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edac77-a75e-4f23-8326-10bacd5c6339 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:40.541586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:40.567468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b288f5b-e953-4fab-a808-f7e439db9e3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:40.568016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b288f5b-e953-4fab-a808-f7e439db9e3a service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:40.568844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b288f5b-e953-4fab-a808-f7e439db9e3a service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:40.569101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b288f5b-e953-4fab-a808-f7e439db9e3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:40.570708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0b288f5b-e953-4fab-a808-f7e439db9e3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:40.659166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b288f5b-e953-4fab-a808-f7e439db9e3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:40.660778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b288f5b-e953-4fab-a808-f7e439db9e3a service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:40.678713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 546/1109] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:41.727025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba4280-4e06-41a5-ac01-9a85183eca18 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:41.727621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba4280-4e06-41a5-ac01-9a85183eca18 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:41.727621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba4280-4e06-41a5-ac01-9a85183eca18 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:41.729007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 564/1110] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:41.735290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0254-d50d-406e-b5cf-1cc75d62f884 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:41.735755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0254-d50d-406e-b5cf-1cc75d62f884 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:41.735855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b0254-d50d-406e-b5cf-1cc75d62f884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:41.813380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b20b0254-d50d-406e-b5cf-1cc75d62f884 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:41.814532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b20b0254-d50d-406e-b5cf-1cc75d62f884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:41.856405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:41.912017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 547/1111] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:42.061851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba4280-4e06-41a5-ac01-9a85183eca18 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:42.063597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2fba4280-4e06-41a5-ac01-9a85183eca18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:42.209049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba4280-4e06-41a5-ac01-9a85183eca18 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:42.262739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:42.320452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a0569-17f1-4e83-b848-97f05042575d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:42.320990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0569-17f1-4e83-b848-97f05042575d service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:42.321270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0569-17f1-4e83-b848-97f05042575d service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:42.321541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0569-17f1-4e83-b848-97f05042575d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:42.323177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c70a0569-17f1-4e83-b848-97f05042575d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:42.412880 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a0569-17f1-4e83-b848-97f05042575d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:42.414474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a0569-17f1-4e83-b848-97f05042575d service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:42.432712 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 565/1112] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:43.477705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a6d4-87be-4d43-97ac-08f3efb262b3 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:43.478251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a6d4-87be-4d43-97ac-08f3efb262b3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:43.478251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a6d4-87be-4d43-97ac-08f3efb262b3 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:43.479603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 548/1113] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:43.485726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e9e7-e05a-4488-8874-4e0b947df66b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:43.486156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e9e7-e05a-4488-8874-4e0b947df66b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:43.486269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e9e7-e05a-4488-8874-4e0b947df66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:43.560889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-29e5e9e7-e05a-4488-8874-4e0b947df66b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:43.562083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29e5e9e7-e05a-4488-8874-4e0b947df66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:43.564089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:43.657772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 566/1114] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:43.809063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181a6d4-87be-4d43-97ac-08f3efb262b3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:43.810482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3181a6d4-87be-4d43-97ac-08f3efb262b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:43.956246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181a6d4-87be-4d43-97ac-08f3efb262b3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:43.982606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:44.069638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b135b80-a0b7-4268-8931-ae11ad539af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:44.070177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135b80-a0b7-4268-8931-ae11ad539af6 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:44.070455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135b80-a0b7-4268-8931-ae11ad539af6 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:44.070725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135b80-a0b7-4268-8931-ae11ad539af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:44.072355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8b135b80-a0b7-4268-8931-ae11ad539af6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:44.159957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135b80-a0b7-4268-8931-ae11ad539af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:44.161573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135b80-a0b7-4268-8931-ae11ad539af6 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:44.179989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 549/1115] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:46.239951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe011-4258-47fe-8657-45436f19a233 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:46.240493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe011-4258-47fe-8657-45436f19a233 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:46.240493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe011-4258-47fe-8657-45436f19a233 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:46.241841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 567/1116] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:46.247029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387a03-4ff8-431d-82b4-1e14cd0b2036 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:46.247502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387a03-4ff8-431d-82b4-1e14cd0b2036 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:46.247661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387a03-4ff8-431d-82b4-1e14cd0b2036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:46.288523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:46.313122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bc387a03-4ff8-431d-82b4-1e14cd0b2036 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:46.314313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bc387a03-4ff8-431d-82b4-1e14cd0b2036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:46.409132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 550/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:46.693445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe011-4258-47fe-8657-45436f19a233 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:46.695002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b7ffe011-4258-47fe-8657-45436f19a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:46.796740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe011-4258-47fe-8657-45436f19a233 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:46.831174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:46.875487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a332bb-41a0-46d1-9fc2-686eb81e09d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:46.876102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a332bb-41a0-46d1-9fc2-686eb81e09d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:46.876383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a332bb-41a0-46d1-9fc2-686eb81e09d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:46.876655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a332bb-41a0-46d1-9fc2-686eb81e09d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:46.878254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a2a332bb-41a0-46d1-9fc2-686eb81e09d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:46.985113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a332bb-41a0-46d1-9fc2-686eb81e09d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:46.986535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a332bb-41a0-46d1-9fc2-686eb81e09d1 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:47.004642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 568/1118] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:49.303264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a004b-b9d3-4b2a-9db4-d736174d7fb0 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:49.303803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a004b-b9d3-4b2a-9db4-d736174d7fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:49.303895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a004b-b9d3-4b2a-9db4-d736174d7fb0 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:49.305195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 551/1119] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:49.310786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00883e0-b472-48cf-89b6-0026b7cbcb1d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:49.311229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00883e0-b472-48cf-89b6-0026b7cbcb1d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:49.311383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00883e0-b472-48cf-89b6-0026b7cbcb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:49.376147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c00883e0-b472-48cf-89b6-0026b7cbcb1d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:49.377358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c00883e0-b472-48cf-89b6-0026b7cbcb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:49.390519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:49.474163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 569/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:17:49.759999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a004b-b9d3-4b2a-9db4-d736174d7fb0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:49.761563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cc5a004b-b9d3-4b2a-9db4-d736174d7fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:49.862491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a004b-b9d3-4b2a-9db4-d736174d7fb0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:49.875850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:49.936941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081228f-5a3e-45fb-893d-dba929568b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:49.937538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081228f-5a3e-45fb-893d-dba929568b2b service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:49.937814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081228f-5a3e-45fb-893d-dba929568b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:49.938076 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081228f-5a3e-45fb-893d-dba929568b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:49.939682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f081228f-5a3e-45fb-893d-dba929568b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:50.045619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081228f-5a3e-45fb-893d-dba929568b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:50.047057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081228f-5a3e-45fb-893d-dba929568b2b service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:50.066225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 552/1121] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:52.519006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2e481-4bdb-4e71-be5c-a94e6b7ecd62 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:52.519620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2e481-4bdb-4e71-be5c-a94e6b7ecd62 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:52.519620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2e481-4bdb-4e71-be5c-a94e6b7ecd62 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:52.521492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 570/1122] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:52.527253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4de6a-78cb-4703-8a9d-bd4c4fd20092 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:52.527691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4de6a-78cb-4703-8a9d-bd4c4fd20092 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:52.527800 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4de6a-78cb-4703-8a9d-bd4c4fd20092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:52.575464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:52.593791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-60b4de6a-78cb-4703-8a9d-bd4c4fd20092 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:52.594999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-60b4de6a-78cb-4703-8a9d-bd4c4fd20092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:52.690087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 553/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:52.974941 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2e481-4bdb-4e71-be5c-a94e6b7ecd62 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:52.976547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-40d2e481-4bdb-4e71-be5c-a94e6b7ecd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:53.079274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2e481-4bdb-4e71-be5c-a94e6b7ecd62 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:53.119000 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:53.153242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7174-729f-4f76-a515-592f4fc66320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:53.153850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7174-729f-4f76-a515-592f4fc66320 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:53.154132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7174-729f-4f76-a515-592f4fc66320 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:53.154408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7174-729f-4f76-a515-592f4fc66320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:53.156041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8e0e7174-729f-4f76-a515-592f4fc66320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:53.263284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7174-729f-4f76-a515-592f4fc66320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:53.264646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7174-729f-4f76-a515-592f4fc66320 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:53.282519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 571/1124] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:55.529276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3a4a5-4f6e-40ab-a25b-124eca01f94a None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:55.529790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3a4a5-4f6e-40ab-a25b-124eca01f94a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:55.529790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3a4a5-4f6e-40ab-a25b-124eca01f94a None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:55.531131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 554/1125] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:17:55.537111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c0ad-b1a6-4120-b628-6e636fbf5533 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:55.537522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c0ad-b1a6-4120-b628-6e636fbf5533 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:55.537654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c0ad-b1a6-4120-b628-6e636fbf5533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:55.602394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d835c0ad-b1a6-4120-b628-6e636fbf5533 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:55.603630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d835c0ad-b1a6-4120-b628-6e636fbf5533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:55.623675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:55.700849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 572/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:55.985985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3a4a5-4f6e-40ab-a25b-124eca01f94a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:55.987602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-95f3a4a5-4f6e-40ab-a25b-124eca01f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:56.091682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3a4a5-4f6e-40ab-a25b-124eca01f94a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:56.110894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:56.163896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed74f7b-b4e0-4103-95f8-def2e58fbcb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:56.164520 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed74f7b-b4e0-4103-95f8-def2e58fbcb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:56.164797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed74f7b-b4e0-4103-95f8-def2e58fbcb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:56.165067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed74f7b-b4e0-4103-95f8-def2e58fbcb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:56.166654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6ed74f7b-b4e0-4103-95f8-def2e58fbcb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:56.275410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed74f7b-b4e0-4103-95f8-def2e58fbcb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:56.276826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed74f7b-b4e0-4103-95f8-def2e58fbcb7 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:56.294632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 555/1127] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:17:58.584963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649799d-bfd3-4c53-aba9-a0e7d374fa97 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:58.585560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649799d-bfd3-4c53-aba9-a0e7d374fa97 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:58.585560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649799d-bfd3-4c53-aba9-a0e7d374fa97 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:58.586851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 573/1128] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:17:58.592241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d597d9-79b5-421c-8749-7794dc5e3217 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:58.592657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d597d9-79b5-421c-8749-7794dc5e3217 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:58.592771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d597d9-79b5-421c-8749-7794dc5e3217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:58.654913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:58.658554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a4d597d9-79b5-421c-8749-7794dc5e3217 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:17:58.659801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a4d597d9-79b5-421c-8749-7794dc5e3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:58.755545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 556/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:17:59.044876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649799d-bfd3-4c53-aba9-a0e7d374fa97 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:17:59.046431 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5649799d-bfd3-4c53-aba9-a0e7d374fa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:59.148852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649799d-bfd3-4c53-aba9-a0e7d374fa97 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:17:59.198040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:59.221958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d2d64-ecb3-4960-be78-ecbef82fb8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:17:59.222559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2d64-ecb3-4960-be78-ecbef82fb8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:17:59.222835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2d64-ecb3-4960-be78-ecbef82fb8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:17:59.223122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2d64-ecb3-4960-be78-ecbef82fb8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:17:59.224701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6e7d2d64-ecb3-4960-be78-ecbef82fb8a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:17:59.331035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d2d64-ecb3-4960-be78-ecbef82fb8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:17:59.332483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d2d64-ecb3-4960-be78-ecbef82fb8a5 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:17:59.350188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 574/1130] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:01.545609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024d93-eb9e-495d-8a1e-2eb8ddea2ba0 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:01.546147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024d93-eb9e-495d-8a1e-2eb8ddea2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:01.546147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024d93-eb9e-495d-8a1e-2eb8ddea2ba0 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:01.547465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 557/1131] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:01.552829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2c996-6e75-4831-946c-5f2607e3ad97 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:01.553219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2c996-6e75-4831-946c-5f2607e3ad97 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:01.553385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2c996-6e75-4831-946c-5f2607e3ad97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:01.618193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bbb2c996-6e75-4831-946c-5f2607e3ad97 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:01.619423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bbb2c996-6e75-4831-946c-5f2607e3ad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:01.648589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:01.715863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 575/1132] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:01.997495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024d93-eb9e-495d-8a1e-2eb8ddea2ba0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:01.999067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b6024d93-eb9e-495d-8a1e-2eb8ddea2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:02.101895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024d93-eb9e-495d-8a1e-2eb8ddea2ba0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:02.131553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:02.177686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d7f19-412c-460c-bb2b-56abc0b02d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:02.178292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d7f19-412c-460c-bb2b-56abc0b02d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:02.178574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d7f19-412c-460c-bb2b-56abc0b02d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:02.178846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d7f19-412c-460c-bb2b-56abc0b02d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:02.180498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-470d7f19-412c-460c-bb2b-56abc0b02d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:02.289022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d7f19-412c-460c-bb2b-56abc0b02d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:02.290371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d7f19-412c-460c-bb2b-56abc0b02d93 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:02.308895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 558/1133] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:04.512486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bec05-a984-4569-9d1b-78c28f159cac None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:04.513096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bec05-a984-4569-9d1b-78c28f159cac None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:04.513096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bec05-a984-4569-9d1b-78c28f159cac None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:04.514426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 576/1134] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:04.519728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d4ebc-b152-4010-a143-7ccf293759d2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:04.520671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d4ebc-b152-4010-a143-7ccf293759d2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:04.520820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d4ebc-b152-4010-a143-7ccf293759d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:04.587579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-459d4ebc-b152-4010-a143-7ccf293759d2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:04.588788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-459d4ebc-b152-4010-a143-7ccf293759d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:04.597042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:04.684605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 559/1135] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:04.968451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bec05-a984-4569-9d1b-78c28f159cac None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:04.969986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1d2bec05-a984-4569-9d1b-78c28f159cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:05.072766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bec05-a984-4569-9d1b-78c28f159cac None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:05.127057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:05.145944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67eac9-0283-4a91-9c5f-8f46d7750b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:05.146558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67eac9-0283-4a91-9c5f-8f46d7750b09 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:05.146836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67eac9-0283-4a91-9c5f-8f46d7750b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:05.147139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67eac9-0283-4a91-9c5f-8f46d7750b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:05.148925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5b67eac9-0283-4a91-9c5f-8f46d7750b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:05.257421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67eac9-0283-4a91-9c5f-8f46d7750b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:05.258801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67eac9-0283-4a91-9c5f-8f46d7750b09 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:05.277115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 577/1136] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:07.461021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748062e5-1a2d-473f-96db-082892a2f000 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:07.461558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748062e5-1a2d-473f-96db-082892a2f000 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:07.461558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748062e5-1a2d-473f-96db-082892a2f000 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:07.462835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 560/1137] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:07.468202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccd816-be67-4575-8a11-879ebb9268ae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:07.468604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccd816-be67-4575-8a11-879ebb9268ae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:07.468763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccd816-be67-4575-8a11-879ebb9268ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:07.539581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7cccd816-be67-4575-8a11-879ebb9268ae None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:07.540794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7cccd816-be67-4575-8a11-879ebb9268ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:07.578995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:07.637581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 578/1138] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:07.923015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748062e5-1a2d-473f-96db-082892a2f000 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:07.924576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-748062e5-1a2d-473f-96db-082892a2f000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:08.029896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748062e5-1a2d-473f-96db-082892a2f000 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:08.068025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:08.103360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bbaa8-2d1a-4db7-bdd4-99ee3a38ecf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:08.103984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bbaa8-2d1a-4db7-bdd4-99ee3a38ecf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:08.104246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bbaa8-2d1a-4db7-bdd4-99ee3a38ecf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:08.104519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bbaa8-2d1a-4db7-bdd4-99ee3a38ecf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:08.106125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f05bbaa8-2d1a-4db7-bdd4-99ee3a38ecf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:08.215048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bbaa8-2d1a-4db7-bdd4-99ee3a38ecf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:08.216592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bbaa8-2d1a-4db7-bdd4-99ee3a38ecf8 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:08.234206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 561/1139] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:10.399377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1a12-2078-4f49-a492-c3883739d5e2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:10.399956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1a12-2078-4f49-a492-c3883739d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:10.399956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1a12-2078-4f49-a492-c3883739d5e2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:10.401292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 579/1140] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:10.406726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1901ca9-b632-45e4-b6a0-679bbbdd9836 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:10.407173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1901ca9-b632-45e4-b6a0-679bbbdd9836 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:10.407317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1901ca9-b632-45e4-b6a0-679bbbdd9836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:10.474079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f1901ca9-b632-45e4-b6a0-679bbbdd9836 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:10.475312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f1901ca9-b632-45e4-b6a0-679bbbdd9836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:10.493782 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:10.579348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 562/1141] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:10.889944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d1a12-2078-4f49-a492-c3883739d5e2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:10.891507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-957d1a12-2078-4f49-a492-c3883739d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:11.001657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d1a12-2078-4f49-a492-c3883739d5e2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:11.070567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:11.077582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85a27a-1624-4955-a4aa-51f9e98f4a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:11.078192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a27a-1624-4955-a4aa-51f9e98f4a2a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:11.078476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a27a-1624-4955-a4aa-51f9e98f4a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:11.078753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85a27a-1624-4955-a4aa-51f9e98f4a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:11.080395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9f85a27a-1624-4955-a4aa-51f9e98f4a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:11.188551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85a27a-1624-4955-a4aa-51f9e98f4a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:11.190002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85a27a-1624-4955-a4aa-51f9e98f4a2a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:11.208792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 580/1142] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:13.377278 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726b60-3ac9-437b-95aa-32f372e9af53 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:13.377839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726b60-3ac9-437b-95aa-32f372e9af53 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:13.377839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726b60-3ac9-437b-95aa-32f372e9af53 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:13.379868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 563/1143] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:13.385350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480e3c7-5ad5-46e5-bf87-4748d73580fc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:13.385787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480e3c7-5ad5-46e5-bf87-4748d73580fc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:13.385903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480e3c7-5ad5-46e5-bf87-4748d73580fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:13.451470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3480e3c7-5ad5-46e5-bf87-4748d73580fc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:13.452596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3480e3c7-5ad5-46e5-bf87-4748d73580fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:13.499691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:13.547360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 581/1144] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:13.831641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726b60-3ac9-437b-95aa-32f372e9af53 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:13.833825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-52726b60-3ac9-437b-95aa-32f372e9af53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:13.937901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726b60-3ac9-437b-95aa-32f372e9af53 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:13.985720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:14.012263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288d03d-21b3-4233-8791-bf5cadfbd3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:14.012869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d03d-21b3-4233-8791-bf5cadfbd3da service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:14.013150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d03d-21b3-4233-8791-bf5cadfbd3da service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:14.013421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d03d-21b3-4233-8791-bf5cadfbd3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:14.015043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c288d03d-21b3-4233-8791-bf5cadfbd3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:14.122553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288d03d-21b3-4233-8791-bf5cadfbd3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:14.124036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288d03d-21b3-4233-8791-bf5cadfbd3da service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:14.142225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 564/1145] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:23.545874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=22 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:24.139985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=66 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:33.971479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a840-346b-4355-a6c0-4e78ff29efc1 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:33.972092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a840-346b-4355-a6c0-4e78ff29efc1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:33.972092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a840-346b-4355-a6c0-4e78ff29efc1 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:33.973928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 582/1146] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:33.979518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2677-33b6-4312-b69c-924a7b511f2a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:33.980061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2677-33b6-4312-b69c-924a7b511f2a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:33.980061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2677-33b6-4312-b69c-924a7b511f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:34.045526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-edcd2677-33b6-4312-b69c-924a7b511f2a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:34.046745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-edcd2677-33b6-4312-b69c-924a7b511f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:34.146227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 565/1147] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:34.444340 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687a7ee-e06a-445e-ada6-c46aa9f56c0b None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:34.444628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687a7ee-e06a-445e-ada6-c46aa9f56c0b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:34.444907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687a7ee-e06a-445e-ada6-c46aa9f56c0b None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:34.446250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 583/1148] 10.222.0.46 () {54 vars in 962 bytes} [Wed Oct 19 13:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:34.451204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efbb09-2741-4ec6-882a-10132d1c9095 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:34.451498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efbb09-2741-4ec6-882a-10132d1c9095 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:34.451774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efbb09-2741-4ec6-882a-10132d1c9095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:34.528340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-03efbb09-2741-4ec6-882a-10132d1c9095 None None] MFA Rules not processed for user `997c5e419c4045f4b8db4f6c1865d18b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:34.529556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-03efbb09-2741-4ec6-882a-10132d1c9095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:34.550272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:34.608077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 566/1149] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Oct 19 13:18:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:34.615953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687a7ee-e06a-445e-ada6-c46aa9f56c0b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:34.617452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1687a7ee-e06a-445e-ada6-c46aa9f56c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:34.719339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687a7ee-e06a-445e-ada6-c46aa9f56c0b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:34.793869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96252bb-99f6-48c3-91da-9f3a48fd9147 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:34.794476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96252bb-99f6-48c3-91da-9f3a48fd9147 service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:34.794758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96252bb-99f6-48c3-91da-9f3a48fd9147 service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:34.795033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96252bb-99f6-48c3-91da-9f3a48fd9147 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:34.796650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f96252bb-99f6-48c3-91da-9f3a48fd9147 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:34.849882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:34.903709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96252bb-99f6-48c3-91da-9f3a48fd9147 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:34.905149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96252bb-99f6-48c3-91da-9f3a48fd9147 service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:34.923130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 584/1150] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:37.152718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f93e-8fd8-4d43-b539-1e8aecc67731 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:37.153283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f93e-8fd8-4d43-b539-1e8aecc67731 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:37.153283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f93e-8fd8-4d43-b539-1e8aecc67731 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:37.154631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 567/1151] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:37.159868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aef02-58f3-414c-b833-29cf605806be None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:37.160806 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aef02-58f3-414c-b833-29cf605806be None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:37.160984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aef02-58f3-414c-b833-29cf605806be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:37.226642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b46aef02-58f3-414c-b833-29cf605806be None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:37.227870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b46aef02-58f3-414c-b833-29cf605806be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:37.327809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 585/1152] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:37.602469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f93e-8fd8-4d43-b539-1e8aecc67731 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:37.604057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-14a6f93e-8fd8-4d43-b539-1e8aecc67731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:37.728392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f93e-8fd8-4d43-b539-1e8aecc67731 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:37.778934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:37.823610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d36b-97c0-4bf1-ba6c-b8952f09de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:37.824219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d36b-97c0-4bf1-ba6c-b8952f09de2a admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:37.824500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d36b-97c0-4bf1-ba6c-b8952f09de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:37.824773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d36b-97c0-4bf1-ba6c-b8952f09de2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:37.825405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897d36b-97c0-4bf1-ba6c-b8952f09de2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:37.826516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-0897d36b-97c0-4bf1-ba6c-b8952f09de2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:18:37.826516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:18:37.826516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:18:37.827686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897d36b-97c0-4bf1-ba6c-b8952f09de2a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:37.846759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 568/1153] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Oct 19 13:18:37 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:18:40.009236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87c75-cf3e-48b4-956d-86dbd1812ad4 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:40.009848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87c75-cf3e-48b4-956d-86dbd1812ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:40.009848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87c75-cf3e-48b4-956d-86dbd1812ad4 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:40.011168 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 586/1154] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:40.016468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051294bb-e9ee-4e14-841a-caebac7ddb10 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:40.016880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051294bb-e9ee-4e14-841a-caebac7ddb10 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:40.017021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051294bb-e9ee-4e14-841a-caebac7ddb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:40.082355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-051294bb-e9ee-4e14-841a-caebac7ddb10 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:40.083607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-051294bb-e9ee-4e14-841a-caebac7ddb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:40.180119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 569/1155] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:40.475168 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87c75-cf3e-48b4-956d-86dbd1812ad4 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:40.476760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5da87c75-cf3e-48b4-956d-86dbd1812ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:40.486866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:40.620545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87c75-cf3e-48b4-956d-86dbd1812ad4 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:40.699878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:40.733633 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45e8bf-158f-4593-bd76-fcf8352a368c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:40.734245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45e8bf-158f-4593-bd76-fcf8352a368c service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:40.734524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45e8bf-158f-4593-bd76-fcf8352a368c service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:40.734796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45e8bf-158f-4593-bd76-fcf8352a368c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:40.736410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7f45e8bf-158f-4593-bd76-fcf8352a368c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:40.825131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45e8bf-158f-4593-bd76-fcf8352a368c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:40.826796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45e8bf-158f-4593-bd76-fcf8352a368c service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:40.844997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 587/1156] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:43.183504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1763-262b-411a-872c-570075221622 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:43.184077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1763-262b-411a-872c-570075221622 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:43.184077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1763-262b-411a-872c-570075221622 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:43.185437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 570/1157] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:43.190839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9da7-d5d5-46b4-ab20-968566dac88e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:43.191303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9da7-d5d5-46b4-ab20-968566dac88e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:43.191470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9da7-d5d5-46b4-ab20-968566dac88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:43.255788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4f5d9da7-d5d5-46b4-ab20-968566dac88e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:43.256986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4f5d9da7-d5d5-46b4-ab20-968566dac88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:43.302456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:43.353085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 588/1158] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:43.646446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1763-262b-411a-872c-570075221622 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:43.648049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e9ff1763-262b-411a-872c-570075221622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:43.673182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:43.753453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1763-262b-411a-872c-570075221622 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:43.825184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9c01c-1676-47c6-8b22-a1549cd04b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:43.825781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9c01c-1676-47c6-8b22-a1549cd04b7d service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:43.826058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9c01c-1676-47c6-8b22-a1549cd04b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:43.826324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9c01c-1676-47c6-8b22-a1549cd04b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:43.828010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5fa9c01c-1676-47c6-8b22-a1549cd04b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:43.899986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:43.934971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9c01c-1676-47c6-8b22-a1549cd04b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:43.936434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9c01c-1676-47c6-8b22-a1549cd04b7d service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:43.953742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 571/1159] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:18:46.155485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1f1bb-0266-4848-b5c3-df27fd311376 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:46.156020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1f1bb-0266-4848-b5c3-df27fd311376 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:46.156020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1f1bb-0266-4848-b5c3-df27fd311376 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:46.157428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 589/1160] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:46.162809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470e3f-3b18-4fec-b102-acd1ca056596 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:46.163303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470e3f-3b18-4fec-b102-acd1ca056596 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:46.163429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470e3f-3b18-4fec-b102-acd1ca056596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:46.229818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-39470e3f-3b18-4fec-b102-acd1ca056596 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:46.231036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-39470e3f-3b18-4fec-b102-acd1ca056596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:46.327722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 572/1161] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:46.618342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1f1bb-0266-4848-b5c3-df27fd311376 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:46.619937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-75d1f1bb-0266-4848-b5c3-df27fd311376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:46.721907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1f1bb-0266-4848-b5c3-df27fd311376 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:46.792498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:46.794089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a350c8-9826-4419-a86b-227ab1c35769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:46.794717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a350c8-9826-4419-a86b-227ab1c35769 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:46.795067 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a350c8-9826-4419-a86b-227ab1c35769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:46.795622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a350c8-9826-4419-a86b-227ab1c35769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:46.797629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-82a350c8-9826-4419-a86b-227ab1c35769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:46.906672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a350c8-9826-4419-a86b-227ab1c35769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:46.908044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a350c8-9826-4419-a86b-227ab1c35769 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:46.925518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 590/1162] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:49.170874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660a3de-150e-4a3e-97cb-eb68c9e443cc None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:49.171472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660a3de-150e-4a3e-97cb-eb68c9e443cc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:49.171472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660a3de-150e-4a3e-97cb-eb68c9e443cc None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:49.172884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 573/1163] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:49.178757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9d29-aebd-4913-a874-6c29382bba2f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:49.179213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9d29-aebd-4913-a874-6c29382bba2f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:49.179346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9d29-aebd-4913-a874-6c29382bba2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:49.244665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-16eb9d29-aebd-4913-a874-6c29382bba2f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:49.245873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-16eb9d29-aebd-4913-a874-6c29382bba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:49.298057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:49.347215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 591/1164] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:49.634917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660a3de-150e-4a3e-97cb-eb68c9e443cc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:49.636485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c660a3de-150e-4a3e-97cb-eb68c9e443cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:49.672240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:49.740915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660a3de-150e-4a3e-97cb-eb68c9e443cc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:49.812372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c034c7-50f2-40b2-a11c-45474a567c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:49.812973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c034c7-50f2-40b2-a11c-45474a567c2a service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:49.813249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c034c7-50f2-40b2-a11c-45474a567c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:49.813519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c034c7-50f2-40b2-a11c-45474a567c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:49.815131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-91c034c7-50f2-40b2-a11c-45474a567c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:49.894962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:49.923451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c034c7-50f2-40b2-a11c-45474a567c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:49.924899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c034c7-50f2-40b2-a11c-45474a567c2a service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:49.943302 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 574/1165] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:18:52.268606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c703-1e8f-4821-9901-deab113555c3 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:52.269171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c703-1e8f-4821-9901-deab113555c3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:52.269171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c703-1e8f-4821-9901-deab113555c3 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:52.270552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 592/1166] 10.222.0.46 () {54 vars in 927 bytes} [Wed Oct 19 13:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:18:52.275870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57e18-5bbe-4b35-9f98-40f57155a31e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:52.276300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57e18-5bbe-4b35-9f98-40f57155a31e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:52.276415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57e18-5bbe-4b35-9f98-40f57155a31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:52.342030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e5b57e18-5bbe-4b35-9f98-40f57155a31e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:18:52.343277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e5b57e18-5bbe-4b35-9f98-40f57155a31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:52.438888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 575/1167] 10.222.0.46 () {58 vars in 1024 bytes} [Wed Oct 19 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:18:52.724393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760c703-1e8f-4821-9901-deab113555c3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:18:52.725919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0760c703-1e8f-4821-9901-deab113555c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:52.827900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760c703-1e8f-4821-9901-deab113555c3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:18:52.902372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a5b8c-0efc-4485-9382-4b99f635f4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:18:52.902978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5b8c-0efc-4485-9382-4b99f635f4ba service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:18:52.903286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5b8c-0efc-4485-9382-4b99f635f4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:18:52.903555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5b8c-0efc-4485-9382-4b99f635f4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:18:52.905144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e20a5b8c-0efc-4485-9382-4b99f635f4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:18:52.913977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:53.013109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a5b8c-0efc-4485-9382-4b99f635f4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:18:53.014445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a5b8c-0efc-4485-9382-4b99f635f4ba service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:18:53.032210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 593/1168] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:19:02.437385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=82 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:03.029989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=50 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:21.739468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:21.740047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:21.740047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:21.817815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:20:21.818944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:21.912830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 576/1169] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:20:21.920750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496910a-537b-4452-8883-827990240fea None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:21.921264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496910a-537b-4452-8883-827990240fea None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:21.921362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496910a-537b-4452-8883-827990240fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:21.995625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d496910a-537b-4452-8883-827990240fea None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:20:21.996854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d496910a-537b-4452-8883-827990240fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:22.091772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 594/1170] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:20:22.096477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:22.097725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:22.109133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d14a63-9dc4-4442-81c5-a47897dbb8e8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:22.169841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:22.206601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:22.207607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:22.208081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:22.208546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:22.209288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:20:22.209592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:22.210607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:20:22.210607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:20:22.210607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:20:22.211556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:22.223105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 577/1171] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:20:22.232305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496910a-537b-4452-8883-827990240fea None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:22.241991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496910a-537b-4452-8883-827990240fea None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:22.303616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:22.337282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:22.337821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:22.338094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:22.338359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:22.338993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:22.340242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:20:22.340242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:20:22.340242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:20:22.341460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:22.396007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 595/1172] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:20:22 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:20:22.400264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:22.401823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:22.435837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b96d5-4793-46de-a0e6-c7e01a56a362 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:22.529011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:22.529615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:22.529896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:22.530166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:22.530804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:22.531857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:20:22.531857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:20:22.531857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:20:22.533089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:22.575413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 578/1173] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:20:22 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:20:22.579456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:22.580953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:22.641226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d2add-bcee-4ae7-9c28-15e70fb7a2e3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:22.724315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:22.735827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:22.736439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:22.736721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:22.736995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:22.737646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:22.739838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:22.751909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 596/1174] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:20:22.755930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:22.757470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:22.768770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093c6ff-08b4-4a43-b9de-1b3bc38e6b16 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:22.793619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:22.863664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2833610-4123-446a-82ab-824d70c913d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:22.864299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833610-4123-446a-82ab-824d70c913d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:22.864580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833610-4123-446a-82ab-824d70c913d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:22.864854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833610-4123-446a-82ab-824d70c913d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:22.865651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2833610-4123-446a-82ab-824d70c913d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:22.867520 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2833610-4123-446a-82ab-824d70c913d4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:22.879814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 579/1175] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:20:22.883935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:22.885468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:22.918528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda30ae-4454-4037-ab0c-f1a4eaae4125 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:23.009834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4064e-65e4-40bd-bed7-5332710506fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:23.010508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4064e-65e4-40bd-bed7-5332710506fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:23.010771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4064e-65e4-40bd-bed7-5332710506fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:23.011047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4064e-65e4-40bd-bed7-5332710506fd admin admin] PATH_INFO: `/v3/projects/76636acb4eea4c91aa6235e96d1a83cb/users/26f8952733214a19893d148f690fb6ed/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:23.033868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4064e-65e4-40bd-bed7-5332710506fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=76636acb4eea4c91aa6235e96d1a83cb, user_id=26f8952733214a19893d148f690fb6ed, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:23.037194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4064e-65e4-40bd-bed7-5332710506fd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:23.062022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 597/1176] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:20:22 2022] PUT /identity/v3/projects/76636acb4eea4c91aa6235e96d1a83cb/users/26f8952733214a19893d148f690fb6ed/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:20:23.073283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f15b5-e570-4c62-b343-07414c235bba None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:23.073576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f15b5-e570-4c62-b343-07414c235bba None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:23.073851 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f15b5-e570-4c62-b343-07414c235bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:23.131119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-946f15b5-e570-4c62-b343-07414c235bba None None] MFA Rules not processed for user `26f8952733214a19893d148f690fb6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:20:23.132336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-946f15b5-e570-4c62-b343-07414c235bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:23.210327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 580/1177] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:20:23.224131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7918d-3695-4ec7-a8af-1072b21819ca None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:23.224424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7918d-3695-4ec7-a8af-1072b21819ca None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:23.224700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7918d-3695-4ec7-a8af-1072b21819ca None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:23.226066 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 598/1178] 10.222.0.46 () {54 vars in 963 bytes} [Wed Oct 19 13:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:20:23.230827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6b96-fe60-49be-8401-a3a7523d73d7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:23.231155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6b96-fe60-49be-8401-a3a7523d73d7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:23.231439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6b96-fe60-49be-8401-a3a7523d73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:23.262286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:23.307824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fb2c6b96-fe60-49be-8401-a3a7523d73d7 None None] MFA Rules not processed for user `908ecd4f59ba49e7bec2a57700bdf957`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:20:23.309041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fb2c6b96-fe60-49be-8401-a3a7523d73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:23.384829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 581/1179] 10.222.0.46 () {58 vars in 1060 bytes} [Wed Oct 19 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:20:23.392493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7918d-3695-4ec7-a8af-1072b21819ca None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:23.394007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a1f7918d-3695-4ec7-a8af-1072b21819ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:23.444088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:23.497338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7918d-3695-4ec7-a8af-1072b21819ca None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:23.569142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:23.569746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:23.570025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:23.570296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:23.571924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:23.671188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:23.672620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:23.676589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:23.691505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 599/1180] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:20:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:20:23.737426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2acb49-cb5b-49a3-a09f-1be60d189513 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:23.737718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2acb49-cb5b-49a3-a09f-1be60d189513 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:23.737992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2acb49-cb5b-49a3-a09f-1be60d189513 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:23.739661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 582/1181] 10.222.0.46 () {52 vars in 830 bytes} [Wed Oct 19 13:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:20:23.743174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:23.744386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:23.843905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177020-f00b-4777-9092-212100c4f758 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:23.936857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:23.937482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:23.937760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:23.938036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] PATH_INFO: `/v3/users/26f8952733214a19893d148f690fb6ed` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:23.950579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f8952733214a19893d148f690fb6ed)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:23.951567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:20:23.951567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:20:23.951567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:20:23.952798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:23.962761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:24.017693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f8952733214a19893d148f690fb6ed'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:24.018343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f8952733214a19893d148f690fb6ed'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:24.032438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f8952733214a19893d148f690fb6ed'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:24.055419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f8952733214a19893d148f690fb6ed'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:24.055872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f8952733214a19893d148f690fb6ed'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:24.070877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 600/1182] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:20:23 2022] DELETE /identity/v3/users/26f8952733214a19893d148f690fb6ed => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:20:24.075503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:24.076047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:24.076047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:24.132792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:20:24.133985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:24.210210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:24.223507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 583/1183] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:20:24.233460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:24.234718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:24.339984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3728b49-d1cb-4f8f-8f7c-53c6945252f3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:24.395954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:24.416448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6517c-de04-4c06-8346-48116765852e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:24.417065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6517c-de04-4c06-8346-48116765852e service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:24.417339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6517c-de04-4c06-8346-48116765852e service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:24.417619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6517c-de04-4c06-8346-48116765852e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:24.419291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-63a6517c-de04-4c06-8346-48116765852e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:24.526482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6517c-de04-4c06-8346-48116765852e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:24.527868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6517c-de04-4c06-8346-48116765852e service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:24.546516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 601/1184] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:20:25.269517 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:20:25.270992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:20:25.282974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbccb4-e837-4acf-886a-ceb5779be968 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:20:25.388246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:20:25.388885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:20:25.389164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:20:25.389433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] PATH_INFO: `/v3/projects/76636acb4eea4c91aa6235e96d1a83cb` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:20:25.400017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76636acb4eea4c91aa6235e96d1a83cb)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:20:25.401064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:20:25.401064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:20:25.401064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:20:25.402257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:20:25.459462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76636acb4eea4c91aa6235e96d1a83cb', 'request_id': 'req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:25.472414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76636acb4eea4c91aa6235e96d1a83cb', 'request_id': 'req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:25.481681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76636acb4eea4c91aa6235e96d1a83cb', 'request_id': 'req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:25.505764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] The token cache is being invalidate because project 76636acb4eea4c91aa6235e96d1a83cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:20:25.506062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:25.506580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-658ae1a6-a3d0-40f2-91a3-a3b81f401b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:20:25.507922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 584/1185] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:20:25 2022] DELETE /identity/v3/projects/76636acb4eea4c91aa6235e96d1a83cb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:20:34.544379 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=62 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:35.503319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:01.660762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042fa9-558d-417c-a3f0-6c91bfe1bcee None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:01.661444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042fa9-558d-417c-a3f0-6c91bfe1bcee None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:01.661444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042fa9-558d-417c-a3f0-6c91bfe1bcee None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:01.662704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 602/1186] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:01.668042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212dba-1a02-4af8-9d70-b2c5383805e6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:01.668507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212dba-1a02-4af8-9d70-b2c5383805e6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:01.668624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc212dba-1a02-4af8-9d70-b2c5383805e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:01.747753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cc212dba-1a02-4af8-9d70-b2c5383805e6 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:01.748959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cc212dba-1a02-4af8-9d70-b2c5383805e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:01.852958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 585/1187] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:02.008632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042fa9-558d-417c-a3f0-6c91bfe1bcee None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:02.010786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-21042fa9-558d-417c-a3f0-6c91bfe1bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:02.128290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042fa9-558d-417c-a3f0-6c91bfe1bcee None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:02.134305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1eed9-3e97-4aa2-a7cd-fb942cdb85c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:02.134919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1eed9-3e97-4aa2-a7cd-fb942cdb85c8 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:02.135696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1eed9-3e97-4aa2-a7cd-fb942cdb85c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:02.135696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1eed9-3e97-4aa2-a7cd-fb942cdb85c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:02.143928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1eed9-3e97-4aa2-a7cd-fb942cdb85c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:02.145598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1eed9-3e97-4aa2-a7cd-fb942cdb85c8 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:02.155304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 603/1188] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:03.226196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec246b7-d816-464b-9b3f-001a7012f8c0 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:03.226713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec246b7-d816-464b-9b3f-001a7012f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:03.226823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec246b7-d816-464b-9b3f-001a7012f8c0 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:03.228134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 586/1189] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:03.234324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16af0-8049-4a6a-9747-c2ceb5db856a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:03.234747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16af0-8049-4a6a-9747-c2ceb5db856a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:03.234885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc16af0-8049-4a6a-9747-c2ceb5db856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:03.254338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8dc16af0-8049-4a6a-9747-c2ceb5db856a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:03.256095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8dc16af0-8049-4a6a-9747-c2ceb5db856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:03.263912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 604/1190] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:03.413113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec246b7-d816-464b-9b3f-001a7012f8c0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:03.428055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec246b7-d816-464b-9b3f-001a7012f8c0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:03.433445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3542a-3a63-4b90-845d-9c235e56ac69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:03.434042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3542a-3a63-4b90-845d-9c235e56ac69 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:03.434573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3542a-3a63-4b90-845d-9c235e56ac69 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:03.435398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3542a-3a63-4b90-845d-9c235e56ac69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:03.444020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3542a-3a63-4b90-845d-9c235e56ac69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:03.445614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3542a-3a63-4b90-845d-9c235e56ac69 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:03.454801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 587/1191] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:04.261466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161874-93cd-484b-b36a-8dcb900a3534 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:04.262001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161874-93cd-484b-b36a-8dcb900a3534 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:04.262001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161874-93cd-484b-b36a-8dcb900a3534 None None] PATH_INFO: `/v3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:04.263307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 605/1192] 10.222.0.16 () {54 vars in 925 bytes} [Wed Oct 19 13:22:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:22:04.286122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8a5c7-410e-4bba-8fbe-2e0579d71939 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:04.286602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8a5c7-410e-4bba-8fbe-2e0579d71939 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:04.287317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8a5c7-410e-4bba-8fbe-2e0579d71939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:04.347246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3ab8a5c7-410e-4bba-8fbe-2e0579d71939 None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:04.348461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3ab8a5c7-410e-4bba-8fbe-2e0579d71939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:04.364579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:04.418048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 588/1193] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 19 13:22:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:08.211256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13601-77fc-47e9-a924-5a73bd85c9a8 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:08.211778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13601-77fc-47e9-a924-5a73bd85c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:08.211910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13601-77fc-47e9-a924-5a73bd85c9a8 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:08.213195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 606/1194] 10.222.0.46 () {54 vars in 961 bytes} [Wed Oct 19 13:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:08.218301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d449f3-a286-4258-9470-bebd5ed0dde0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:08.218721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d449f3-a286-4258-9470-bebd5ed0dde0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:08.218876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d449f3-a286-4258-9470-bebd5ed0dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:08.238990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-52d449f3-a286-4258-9470-bebd5ed0dde0 None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:08.240877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-52d449f3-a286-4258-9470-bebd5ed0dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:08.249572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 589/1195] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Oct 19 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:08.257083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f13601-77fc-47e9-a924-5a73bd85c9a8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:08.270559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f13601-77fc-47e9-a924-5a73bd85c9a8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:08.275570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3e100-cac6-427c-b50e-08dabd43a3e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:08.276195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3e100-cac6-427c-b50e-08dabd43a3e5 service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:08.276477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3e100-cac6-427c-b50e-08dabd43a3e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:08.276813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3e100-cac6-427c-b50e-08dabd43a3e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:08.285025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3e100-cac6-427c-b50e-08dabd43a3e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:08.287231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3e100-cac6-427c-b50e-08dabd43a3e5 service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:08.296726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 607/1196] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:14.915046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837862d-317b-4c1a-a6f8-61d0a89ff483 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:14.915654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837862d-317b-4c1a-a6f8-61d0a89ff483 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:14.915654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837862d-317b-4c1a-a6f8-61d0a89ff483 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:14.916969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 590/1197] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:14.922939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183ace8-d6a1-4ac2-ba77-bb7c6a07ebae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:14.923385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183ace8-d6a1-4ac2-ba77-bb7c6a07ebae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:14.923529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183ace8-d6a1-4ac2-ba77-bb7c6a07ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:14.944157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9183ace8-d6a1-4ac2-ba77-bb7c6a07ebae None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:14.945392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9183ace8-d6a1-4ac2-ba77-bb7c6a07ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:14.953138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 608/1198] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:15.107698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837862d-317b-4c1a-a6f8-61d0a89ff483 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:15.122739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837862d-317b-4c1a-a6f8-61d0a89ff483 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:15.128303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eec83f-7bff-4734-809b-af546c15611d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:15.128899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eec83f-7bff-4734-809b-af546c15611d service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:15.129176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eec83f-7bff-4734-809b-af546c15611d service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:15.129445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eec83f-7bff-4734-809b-af546c15611d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:15.137531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eec83f-7bff-4734-809b-af546c15611d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:15.139133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eec83f-7bff-4734-809b-af546c15611d service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:15.148285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 591/1199] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:16.215841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95ac1-3e50-4cec-ac66-32cc441f859e None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:16.216350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95ac1-3e50-4cec-ac66-32cc441f859e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:16.216470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd95ac1-3e50-4cec-ac66-32cc441f859e None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:16.217754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 609/1200] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 19 13:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:22:16.223701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab00d4b-e501-42b6-a65b-8451788d6c79 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:16.224116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab00d4b-e501-42b6-a65b-8451788d6c79 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:16.224266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab00d4b-e501-42b6-a65b-8451788d6c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:16.243905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3ab00d4b-e501-42b6-a65b-8451788d6c79 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:16.245112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3ab00d4b-e501-42b6-a65b-8451788d6c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:16.252945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 592/1201] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 19 13:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:16.405822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd95ac1-3e50-4cec-ac66-32cc441f859e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:16.420859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd95ac1-3e50-4cec-ac66-32cc441f859e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:16.426471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec19ac-e6b6-4623-910a-8c2ec079fb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:16.427070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec19ac-e6b6-4623-910a-8c2ec079fb56 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:16.427378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec19ac-e6b6-4623-910a-8c2ec079fb56 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:16.427655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec19ac-e6b6-4623-910a-8c2ec079fb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:16.435913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec19ac-e6b6-4623-910a-8c2ec079fb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:16.437520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec19ac-e6b6-4623-910a-8c2ec079fb56 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:16.447320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 610/1202] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:20.458334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ba4d-7dfa-4b66-bba4-1d372c5f69cb None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:20.458850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ba4d-7dfa-4b66-bba4-1d372c5f69cb None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:20.458850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ba4d-7dfa-4b66-bba4-1d372c5f69cb None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:20.460188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 593/1203] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:20.465407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2788c-9407-4f7f-913a-505370580e9e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:20.465907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2788c-9407-4f7f-913a-505370580e9e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:20.466038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2788c-9407-4f7f-913a-505370580e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:20.485334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-aff2788c-9407-4f7f-913a-505370580e9e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:20.486513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-aff2788c-9407-4f7f-913a-505370580e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:20.494700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 611/1204] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:20.777926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ba4d-7dfa-4b66-bba4-1d372c5f69cb None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:20.779679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aee8ba4d-7dfa-4b66-bba4-1d372c5f69cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:20.857364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ba4d-7dfa-4b66-bba4-1d372c5f69cb None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:20.860949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d8a24-3e9c-4711-b04c-f664974a62c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:20.861556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8a24-3e9c-4711-b04c-f664974a62c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:20.861837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8a24-3e9c-4711-b04c-f664974a62c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:20.862109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8a24-3e9c-4711-b04c-f664974a62c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:20.870901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8a24-3e9c-4711-b04c-f664974a62c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:20.872365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8a24-3e9c-4711-b04c-f664974a62c8 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:20.881776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 594/1205] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:23.002627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb8c5-4303-4466-9097-62185b2713c2 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:23.003205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb8c5-4303-4466-9097-62185b2713c2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:23.003205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb8c5-4303-4466-9097-62185b2713c2 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:23.004595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 612/1206] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:23.010276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdfc67-eafd-4b19-8d01-980b1fdb4271 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:23.010728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdfc67-eafd-4b19-8d01-980b1fdb4271 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:23.010845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdfc67-eafd-4b19-8d01-980b1fdb4271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:23.031885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-33cdfc67-eafd-4b19-8d01-980b1fdb4271 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:23.033100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-33cdfc67-eafd-4b19-8d01-980b1fdb4271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:23.040941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 595/1207] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:23.325646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cb8c5-4303-4466-9097-62185b2713c2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:23.337138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cb8c5-4303-4466-9097-62185b2713c2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:23.340633 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c63dfb-ca60-47cb-9998-f6b709ae5829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:23.341231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63dfb-ca60-47cb-9998-f6b709ae5829 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:23.341522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63dfb-ca60-47cb-9998-f6b709ae5829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:23.341798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63dfb-ca60-47cb-9998-f6b709ae5829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:23.350589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c63dfb-ca60-47cb-9998-f6b709ae5829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:23.352060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c63dfb-ca60-47cb-9998-f6b709ae5829 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:23.361367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 613/1208] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:27.320656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e76a-ef72-480a-b91e-59c88f405e24 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:27.321272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e76a-ef72-480a-b91e-59c88f405e24 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:27.321272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31e76a-ef72-480a-b91e-59c88f405e24 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:27.322599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 596/1209] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:27.327787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be130-d662-4b45-8996-13edadc86c3a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:27.328218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be130-d662-4b45-8996-13edadc86c3a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:27.328342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be130-d662-4b45-8996-13edadc86c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:27.336641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=81 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:27.349341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e97be130-d662-4b45-8996-13edadc86c3a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:27.350569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e97be130-d662-4b45-8996-13edadc86c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:27.358349 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 614/1210] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:27.658370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31e76a-ef72-480a-b91e-59c88f405e24 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:27.660112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7d31e76a-ef72-480a-b91e-59c88f405e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:27.724298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:27.738160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31e76a-ef72-480a-b91e-59c88f405e24 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:27.742397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3cc4a-7bd8-401e-aa7b-89ef1cb36b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:27.743068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3cc4a-7bd8-401e-aa7b-89ef1cb36b8d service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:27.743314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3cc4a-7bd8-401e-aa7b-89ef1cb36b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:27.743587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3cc4a-7bd8-401e-aa7b-89ef1cb36b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:27.752401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3cc4a-7bd8-401e-aa7b-89ef1cb36b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:27.753828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3cc4a-7bd8-401e-aa7b-89ef1cb36b8d service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:27.763143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 597/1211] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:29.918982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d6b3-3efb-47ee-8479-e72051ee5f0a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:29.919594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d6b3-3efb-47ee-8479-e72051ee5f0a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:29.919594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d6b3-3efb-47ee-8479-e72051ee5f0a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:29.920954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 615/1212] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 19 13:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:22:29.926045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee906cb-9f44-42ab-8be7-2ce14b424138 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:29.926478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee906cb-9f44-42ab-8be7-2ce14b424138 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:29.926584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee906cb-9f44-42ab-8be7-2ce14b424138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:29.947447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bee906cb-9f44-42ab-8be7-2ce14b424138 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:22:29.948646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bee906cb-9f44-42ab-8be7-2ce14b424138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:29.956396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 598/1213] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 19 13:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:22:30.262314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17d6b3-3efb-47ee-8479-e72051ee5f0a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:22:30.263991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ab17d6b3-3efb-47ee-8479-e72051ee5f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:22:30.277142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17d6b3-3efb-47ee-8479-e72051ee5f0a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:22:30.280578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ef66-ea93-4bbb-9ce6-7a4d5130f262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:22:30.281171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ef66-ea93-4bbb-9ce6-7a4d5130f262 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:22:30.281449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ef66-ea93-4bbb-9ce6-7a4d5130f262 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:22:30.281716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ef66-ea93-4bbb-9ce6-7a4d5130f262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:22:30.290349 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ef66-ea93-4bbb-9ce6-7a4d5130f262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:22:30.291796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ef66-ea93-4bbb-9ce6-7a4d5130f262 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:22:30.301184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 616/1214] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:22:39.941992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=11 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:40.296979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:59.122352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cbe2b-8077-4088-b13a-6848bf28d5b1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.147606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cbe2b-8077-4088-b13a-6848bf28d5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.147606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cbe2b-8077-4088-b13a-6848bf28d5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.153228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ee4cbe2b-8077-4088-b13a-6848bf28d5b1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.157276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ee4cbe2b-8077-4088-b13a-6848bf28d5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:23:59.173805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 599/1215] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:23:59.183637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0e889-00d6-49d2-9641-c7dfdd7d0927 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.184753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0e889-00d6-49d2-9641-c7dfdd7d0927 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.185258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0e889-00d6-49d2-9641-c7dfdd7d0927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.226161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-70e0e889-00d6-49d2-9641-c7dfdd7d0927 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.227883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-70e0e889-00d6-49d2-9641-c7dfdd7d0927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:23:59.240427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 617/1216] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:23:59.244853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cbe2b-8077-4088-b13a-6848bf28d5b1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:23:59.257600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cbe2b-8077-4088-b13a-6848bf28d5b1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:23:59.264547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:23:59.265196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.265480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.265755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.266430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:23:59.266738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:23:59.268438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:23:59.286328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 600/1217] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:23:59.294454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0e889-00d6-49d2-9641-c7dfdd7d0927 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:23:59.306710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0e889-00d6-49d2-9641-c7dfdd7d0927 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:23:59.315257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:23:59.316341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.316869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.317534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.318482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:23:59.320779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:23:59.383797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 618/1218] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:23:59.388406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:23:59.404738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cac10-bc95-49bf-bebe-77d3466e7c99 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:23:59.502664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:23:59.503329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.503614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.503896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.504563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:23:59.507102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:23:59.548368 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 601/1219] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:23:59.552590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:23:59.570208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f9eb6-c5ec-4890-b67c-994ad039101c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:23:59.582016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:23:59.583052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.583647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.584158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.585040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:23:59.587355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:23:59.600808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 619/1220] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:23:59.605554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:23:59.625446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ccdb3-3d52-4588-bd97-123d12967261 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:23:59.635875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdeee1-4c7e-455e-aa32-d3b676968f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:23:59.637082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdeee1-4c7e-455e-aa32-d3b676968f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.637370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdeee1-4c7e-455e-aa32-d3b676968f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.637650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdeee1-4c7e-455e-aa32-d3b676968f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.638553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdeee1-4c7e-455e-aa32-d3b676968f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:23:59.640222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdeee1-4c7e-455e-aa32-d3b676968f05 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:23:59.659317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 602/1221] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:23:59.663734 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:23:59.676570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd002d2-1ff9-45fa-a0bb-5144561d0747 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:23:59.687220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421aa20-a78d-4aed-898e-16db12c50ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:23:59.688579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421aa20-a78d-4aed-898e-16db12c50ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.689261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421aa20-a78d-4aed-898e-16db12c50ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.689773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421aa20-a78d-4aed-898e-16db12c50ee2 admin admin] PATH_INFO: `/v3/projects/1e33fa36c6364814a65e51fbb5497c90/users/b4897dca57b845a6827676bcfaea8461/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.717357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421aa20-a78d-4aed-898e-16db12c50ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e33fa36c6364814a65e51fbb5497c90, user_id=b4897dca57b845a6827676bcfaea8461, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:23:59.721204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421aa20-a78d-4aed-898e-16db12c50ee2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:23:59.742764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 620/1222] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:23:59 2022] PUT /identity/v3/projects/1e33fa36c6364814a65e51fbb5497c90/users/b4897dca57b845a6827676bcfaea8461/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:23:59.754705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f031699-6303-4414-bba3-e17704acb7f3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.755024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f031699-6303-4414-bba3-e17704acb7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.755303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f031699-6303-4414-bba3-e17704acb7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.760780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a57a-c9d6-41c8-ab93-308996f9ee36 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.762089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a57a-c9d6-41c8-ab93-308996f9ee36 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.762737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a57a-c9d6-41c8-ab93-308996f9ee36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.791434 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f582a57a-c9d6-41c8-ab93-308996f9ee36 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.793862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f582a57a-c9d6-41c8-ab93-308996f9ee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:23:59.804794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5f031699-6303-4414-bba3-e17704acb7f3 None None] MFA Rules not processed for user `b4897dca57b845a6827676bcfaea8461`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.806371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5f031699-6303-4414-bba3-e17704acb7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:23:59.906293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 621/1223] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:23:59.907535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed5630-05d2-482b-bdd9-2ea6e46fdc5f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.907824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed5630-05d2-482b-bdd9-2ea6e46fdc5f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.908102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed5630-05d2-482b-bdd9-2ea6e46fdc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.933963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-06ed5630-05d2-482b-bdd9-2ea6e46fdc5f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.934995 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 603/1224] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:23:59.938586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-06ed5630-05d2-482b-bdd9-2ea6e46fdc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:23:59.938718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf20288-88ea-424e-b305-013b74d2207b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.938718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf20288-88ea-424e-b305-013b74d2207b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.938718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf20288-88ea-424e-b305-013b74d2207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.946023 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 622/1225] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:23:59.948138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b4ef5-0b82-4b60-8bce-768ae6ba33f5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.948427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b4ef5-0b82-4b60-8bce-768ae6ba33f5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.948738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b4ef5-0b82-4b60-8bce-768ae6ba33f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.962955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7bf20288-88ea-424e-b305-013b74d2207b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.964339 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7bf20288-88ea-424e-b305-013b74d2207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:23:59.968987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-369b4ef5-0b82-4b60-8bce-768ae6ba33f5 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.970264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-369b4ef5-0b82-4b60-8bce-768ae6ba33f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:23:59.972667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 604/1226] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:23:59.973945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5611f9-83ea-4bc8-af9e-7046e603f781 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.974231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5611f9-83ea-4bc8-af9e-7046e603f781 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.974510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5611f9-83ea-4bc8-af9e-7046e603f781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.982745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 623/1227] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:23:59.987116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a8c2-2e5b-404e-99af-f20897b111ff None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:23:59.987116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a8c2-2e5b-404e-99af-f20897b111ff None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:23:59.987116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846a8c2-2e5b-404e-99af-f20897b111ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:23:59.995247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ec5611f9-83ea-4bc8-af9e-7046e603f781 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:23:59.997025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ec5611f9-83ea-4bc8-af9e-7046e603f781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.005082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 605/1228] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.005971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f846a8c2-2e5b-404e-99af-f20897b111ff None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.006286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0a1d-9539-4c41-9cd7-0c6ced428f48 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.006570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0a1d-9539-4c41-9cd7-0c6ced428f48 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.006846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0a1d-9539-4c41-9cd7-0c6ced428f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.007194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f846a8c2-2e5b-404e-99af-f20897b111ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.015464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 624/1229] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.016249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846a8c2-2e5b-404e-99af-f20897b111ff None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.025472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846a8c2-2e5b-404e-99af-f20897b111ff None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.030268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e60f0a1d-9539-4c41-9cd7-0c6ced428f48 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.030437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c57e-6180-4131-866e-db2401d14119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.030889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c57e-6180-4131-866e-db2401d14119 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.031213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c57e-6180-4131-866e-db2401d14119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.031492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c57e-6180-4131-866e-db2401d14119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.031601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e60f0a1d-9539-4c41-9cd7-0c6ced428f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.032128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c57e-6180-4131-866e-db2401d14119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.034095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c57e-6180-4131-866e-db2401d14119 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.039420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 606/1230] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.040594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4732-5a48-4f70-b866-d47117af2577 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.040878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4732-5a48-4f70-b866-d47117af2577 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.041151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4732-5a48-4f70-b866-d47117af2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.061858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f45b4732-5a48-4f70-b866-d47117af2577 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.063064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f45b4732-5a48-4f70-b866-d47117af2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.071037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 607/1231] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.071566 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 625/1232] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.072835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a098-d139-4cd3-80db-c9153b9998cb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.073127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a098-d139-4cd3-80db-c9153b9998cb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.073433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a098-d139-4cd3-80db-c9153b9998cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.075981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3e48-a215-44d6-92c3-f7c6ff53f19b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.076275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3e48-a215-44d6-92c3-f7c6ff53f19b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.076552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3e48-a215-44d6-92c3-f7c6ff53f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.092733 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6f46a098-d139-4cd3-80db-c9153b9998cb None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.093942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6f46a098-d139-4cd3-80db-c9153b9998cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.095334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-057c3e48-a215-44d6-92c3-f7c6ff53f19b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.096499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-057c3e48-a215-44d6-92c3-f7c6ff53f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.114375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:00.137494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:00.157303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 626/1233] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.158324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 608/1234] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.158837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829993a-62cd-4e98-b792-b88f820901f0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.159101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829993a-62cd-4e98-b792-b88f820901f0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.159386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829993a-62cd-4e98-b792-b88f820901f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.160662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a58ae2-8551-421e-b5d1-d62cd28b0161 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.161171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a58ae2-8551-421e-b5d1-d62cd28b0161 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.161446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a58ae2-8551-421e-b5d1-d62cd28b0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.181375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0829993a-62cd-4e98-b792-b88f820901f0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.181596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a8a58ae2-8551-421e-b5d1-d62cd28b0161 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.182576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a8a58ae2-8551-421e-b5d1-d62cd28b0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.182699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0829993a-62cd-4e98-b792-b88f820901f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.191054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 609/1235] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.195217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 627/1236] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.195735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a58ae2-8551-421e-b5d1-d62cd28b0161 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.195833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ac9c3-beb0-4ab7-9f18-e3750eb0149d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.195833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ac9c3-beb0-4ab7-9f18-e3750eb0149d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.195833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ac9c3-beb0-4ab7-9f18-e3750eb0149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.207600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a58ae2-8551-421e-b5d1-d62cd28b0161 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.212209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.212808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.213086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.213351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.213991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:00.214111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-750ac9c3-beb0-4ab7-9f18-e3750eb0149d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.214821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.215750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-750ac9c3-beb0-4ab7-9f18-e3750eb0149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.216636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.223619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 628/1237] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.224372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ac9c3-beb0-4ab7-9f18-e3750eb0149d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.228938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 610/1238] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:00.229818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.234737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ac9c3-beb0-4ab7-9f18-e3750eb0149d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.240323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.240843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d8ff9-a0ba-4d16-9fbc-18bf35cbc57b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.240982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.241193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.241464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.242120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.243159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:24:00.243159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:24:00.243159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:24:00.244351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.245661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.246165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.246446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.246720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.247396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:00.247707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.249279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.263553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 611/1239] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:00.264382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.268027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 629/1240] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.268827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.280111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc65d-432c-4d0f-ba37-1ce37f0b02e3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.282739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b7009-65e9-41d5-9af3-7f360c6e9943 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.284721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.285317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.285601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.285876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.286515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:00.286891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.287454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.288046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.288346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.288471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.288611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.289248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:00.289551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.290585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:24:00.290585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:24:00.290585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:24:00.291596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f1feb-2317-404e-92c4-e77df48ba934 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.300936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 612/1241] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:00.301737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.311368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 630/1242] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:00.311368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62a035-69ab-4aaa-9c61-c04fb180d44b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.311368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62a035-69ab-4aaa-9c61-c04fb180d44b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.311368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62a035-69ab-4aaa-9c61-c04fb180d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.313798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c7155-cbca-4fef-9010-e5c00217b888 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.318476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.319069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.319383 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.319658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.320328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:00.320634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.322258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.325848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0a62a035-69ab-4aaa-9c61-c04fb180d44b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:00.327044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0a62a035-69ab-4aaa-9c61-c04fb180d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:00.334415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 613/1243] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:00.335195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 631/1244] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:00.336012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62a035-69ab-4aaa-9c61-c04fb180d44b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.338471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.345897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62a035-69ab-4aaa-9c61-c04fb180d44b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.348766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daff2e-5358-474c-a1b2-eb94827ab696 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.350401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.350988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.351292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.351565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.352183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.353628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.354155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.354267 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.354491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.354757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.356027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:00.356333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.357919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.369487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 614/1245] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:00.370398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.380592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540f998-13e3-436c-83d1-003d8a90394e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.384426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 632/1246] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.385224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.388026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.388701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.389057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.389408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.390112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.391247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:24:00.391247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:24:00.391247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:24:00.392443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.423834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 615/1247] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.424717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.449048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dfeea-5ae8-49a0-a4ba-77b2daa0eeb4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.486301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33538a0-51de-47e9-92a6-dc14f1f89860 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.497223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.497844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.498120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.498394 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.499038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.500983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.505996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.506717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.507002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.507311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.507964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.509574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.519823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 633/1248] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:00.520615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.534547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d896a8-d08e-43c8-99e1-c0fa848855d3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.536404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 616/1249] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.537219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.550105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:00.552152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:00.596863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.597481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.597772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.598057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.598694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.600649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.603105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678c805-080c-4737-bb88-02ecb3856126 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.608232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.608870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.609153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.609429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.610072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:00.610381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.612012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.624274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 617/1250] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:00.631600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.631736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 634/1251] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.631736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.637175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3602f-93fb-4c79-84dc-28c00be3a45a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.693940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b499ba8-ef46-4eff-9ace-c2fc9148e14c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.697119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.697726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.698001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.698275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.698814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.698961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.699457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.699739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.700012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.700645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.700854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.702613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.728427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 618/1252] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.732924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.733081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 635/1253] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.733081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.794181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9978-a45b-47ee-9575-9f58af22a87d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.794429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedec9c-f57f-43ee-988b-e2cf91d055ea admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.798767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.798919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.799412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.799534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.799768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.799873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.800042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.800148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.800677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.800794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.802602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.802729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.824721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 636/1254] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.828654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.828802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 619/1255] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.828802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.837602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242a265-5f5c-4de7-b548-b47bbb0577af admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.839290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff20cdd-4f36-42c8-b380-4dbd23b47a72 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.842489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.843110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.843407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.843683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.843876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.844322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.844520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.844801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.845076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] PATH_INFO: `/v3/projects/548907bd223648189f8518193c83a506/users/933966e0ebf3441bae60634e69504e2f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.846257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.861626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=548907bd223648189f8518193c83a506, user_id=933966e0ebf3441bae60634e69504e2f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.864662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.866845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:00.868492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 620/1256] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.869308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.876346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:00.880501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15801514-5664-4013-9ce4-966f016b73cf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.883554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 637/1257] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:00 2022] PUT /identity/v3/projects/548907bd223648189f8518193c83a506/users/933966e0ebf3441bae60634e69504e2f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:00.887333 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.940052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.940672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.940954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.941230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.941893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.943853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.949316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387322c8-71ef-4964-ba6c-e53b2b89f19c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:00.953972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:00.954581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:00.954882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:00.955166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:00.955802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:00.957710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:00.971230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 621/1258] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.972237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.980539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 638/1259] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:00.981384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:00.991141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9d577-6b6a-42a9-aead-79acc2bfb2c0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.039913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76441d05-d483-4b06-9144-2d36af7066f8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.046274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.046894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.047204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.047480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.048117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.049675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.050132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.050284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.050567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.050841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.051504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.053409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.074426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 622/1260] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:01.075201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.079173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 639/1261] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:00 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:01.079173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.087241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08005fe-0bc4-486a-827d-c0bbefe3fc71 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.088538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279fc6e-5f28-4e44-b716-4c92d0374599 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.091835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.092450 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.092717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.092995 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.093236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.093669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.093828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.094091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.094365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.095005 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.095308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.096731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.105518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 623/1262] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.106395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.107521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 640/1263] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.108409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.116467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef33f6-9303-4e5a-aaf9-ed155a968d0d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.117787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e6612-c36e-4b55-8c85-7843f963b557 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.121690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.122361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.122707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.122851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.123158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.123454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.123734 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.123989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.124088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.124616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.125754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.126161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.136014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 624/1264] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.136781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 641/1265] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.137416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.137548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.147391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8a55d-2966-46db-82a4-3ac2169cd40f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.148219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2815503-6823-454d-9a74-50f7c6a846cf admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.152016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.152604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.152787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.152917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.153139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.153368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.153650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.153757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.153926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.154560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.155702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.156166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.166850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 642/1266] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.171003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.185173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 625/1267] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:01 2022] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:01.185704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ff55d-158d-4a46-9013-fcace3628885 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.185810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.190592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.191135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.191422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.191700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.192369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.192919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a5193-9383-4e59-a22e-c3f36cd2cb73 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.193997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.197973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.198635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.199613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.200458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.201164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.202764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.205063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 643/1268] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.205859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.216526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 626/1269] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.216526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.216783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96e78-44d9-40a3-b3ac-41a1f803012e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.220607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.221273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.221562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.221838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.222473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.224083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.224190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f4305-4bbc-49c6-a6f3-85ee2fc641bc admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.228928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.229508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.229783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.230085 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.230714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.232303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.233954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 644/1270] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.234733 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.243978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d03b5-167f-4355-8583-76cc3d35e2f7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.249150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 627/1271] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.249150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.252409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.253012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.253296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.253575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.254219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.255843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.258513 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad339f-fd96-4d36-b0fc-dc7f87adcbfc admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.263820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.264449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.264729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.265012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] PATH_INFO: `/v3/projects/548907bd223648189f8518193c83a506/users/933966e0ebf3441bae60634e69504e2f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.269735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 645/1272] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.269894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548907bd223648189f8518193c83a506, user_id=933966e0ebf3441bae60634e69504e2f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.269984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.270062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.277173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1bb5-2226-4a51-a1ab-70c539c00704 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.280905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 628/1273] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:01 2022] PUT /identity/v3/projects/548907bd223648189f8518193c83a506/users/933966e0ebf3441bae60634e69504e2f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:01.281142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:01.281889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.288880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:01.340522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.341167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.341448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.341722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.342388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.344029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.349831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f2ece-f21e-476f-8b62-5a7dbe901703 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.353715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 646/1274] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.354580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.354707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.356444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.356724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.356998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.357650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.359331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.365131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f43f-66af-4878-874a-320481df3a49 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.369527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 629/1275] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.373270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.373384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.373473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.373473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.373473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.373473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.374122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.383070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a87f7-5fe8-4348-9bf8-25d83aba5e51 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.385534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 647/1276] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.386340 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.388018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.388903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.389304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.389586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.390251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.392705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.395830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743de56-39fc-49fe-a536-43f280c8b087 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.400453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.401089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.401372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.401652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] PATH_INFO: `/v3/projects/a3939d685bfd4872810eea74ed7edc0f/users/6f35b75b70c141be869554ef0e30e21d/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.405947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 630/1277] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.405947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.415472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71fc3b-a1ce-4b87-964f-a93e1634dcf7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.418995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3939d685bfd4872810eea74ed7edc0f, user_id=6f35b75b70c141be869554ef0e30e21d, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.420607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280e25-3a47-4a87-82af-055151658dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.421239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280e25-3a47-4a87-82af-055151658dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.421521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280e25-3a47-4a87-82af-055151658dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.421796 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280e25-3a47-4a87-82af-055151658dbd admin admin] PATH_INFO: `/v3/projects/cffb5e81fa3147d893302ee1c23abe9e/users/7cfaf8a4dc1a40ee923e7ac9a4cc1fcd/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.421931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.437269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 648/1278] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:01 2022] PUT /identity/v3/projects/a3939d685bfd4872810eea74ed7edc0f/users/6f35b75b70c141be869554ef0e30e21d/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:01.437444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72280e25-3a47-4a87-82af-055151658dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffb5e81fa3147d893302ee1c23abe9e, user_id=7cfaf8a4dc1a40ee923e7ac9a4cc1fcd, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.438054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.439981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72280e25-3a47-4a87-82af-055151658dbd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.453861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 631/1279] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:01 2022] PUT /identity/v3/projects/cffb5e81fa3147d893302ee1c23abe9e/users/7cfaf8a4dc1a40ee923e7ac9a4cc1fcd/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:01.455328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33fbae-f6ca-4f29-ae5d-d6789f5bb96f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.455621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33fbae-f6ca-4f29-ae5d-d6789f5bb96f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.456025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33fbae-f6ca-4f29-ae5d-d6789f5bb96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.485587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bc33fbae-f6ca-4f29-ae5d-d6789f5bb96f None None] MFA Rules not processed for user `933966e0ebf3441bae60634e69504e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:01.486877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bc33fbae-f6ca-4f29-ae5d-d6789f5bb96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:01.501354 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814e3e-cd5b-4e85-a24e-adedca5f1cc1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.555682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 632/1280] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:01.558940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.559646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.559936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.560216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] PATH_INFO: `/v3/projects/d777a906e5fb45869e62ea130cc98c99/users/30c408bc33b84cadb1b16ac2327011d4/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.560498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33fbae-f6ca-4f29-ae5d-d6789f5bb96f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.570718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33fbae-f6ca-4f29-ae5d-d6789f5bb96f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.575466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d777a906e5fb45869e62ea130cc98c99, user_id=30c408bc33b84cadb1b16ac2327011d4, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.575955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.576626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.576900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.577183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] PATH_INFO: `/v3/projects/2972ad91b2d8447cb07c4ab34a1881dd/users/5d55946aecd64ff88095e59d6ec03c0e/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.578146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.586346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:01.593583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 649/1281] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:01 2022] PUT /identity/v3/projects/d777a906e5fb45869e62ea130cc98c99/users/30c408bc33b84cadb1b16ac2327011d4/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:01.594544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2972ad91b2d8447cb07c4ab34a1881dd, user_id=5d55946aecd64ff88095e59d6ec03c0e, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.597445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.598602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.611507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 633/1282] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:01 2022] PUT /identity/v3/projects/2972ad91b2d8447cb07c4ab34a1881dd/users/5d55946aecd64ff88095e59d6ec03c0e/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:01.615810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.645526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:01.661623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acaa9d-cce7-48d2-9c52-f12bef84fd0c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.680135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10836d9-cd1f-4132-8a5f-c0f4f77392d1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.685112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.685877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.686266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.686548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] PATH_INFO: `/v3/projects/47e88d0765204d839d08bccfc54d596a/users/8f85c5d88c324fd790b6282e714861de/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.701016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e88d0765204d839d08bccfc54d596a, user_id=8f85c5d88c324fd790b6282e714861de, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.703728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.717609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 634/1283] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:01 2022] PUT /identity/v3/projects/47e88d0765204d839d08bccfc54d596a/users/8f85c5d88c324fd790b6282e714861de/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:01.718195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd391e-d892-4c7d-b38e-7963d46eab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.718660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.718958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd391e-d892-4c7d-b38e-7963d46eab5c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.719466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd391e-d892-4c7d-b38e-7963d46eab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.719847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd391e-d892-4c7d-b38e-7963d46eab5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.720513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd391e-d892-4c7d-b38e-7963d46eab5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.722134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd391e-d892-4c7d-b38e-7963d46eab5c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.732725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 650/1284] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:01.734078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfa6c1-8300-4c69-86a7-23d449efd59f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.734367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfa6c1-8300-4c69-86a7-23d449efd59f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.734641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfa6c1-8300-4c69-86a7-23d449efd59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.752688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-08dfa6c1-8300-4c69-86a7-23d449efd59f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:01.753985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-08dfa6c1-8300-4c69-86a7-23d449efd59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:01.781663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd523bd-6b4e-44c3-bea8-3722738991ec admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.786343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.787002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.787399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.787672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] PATH_INFO: `/v3/projects/4b02941368dd4f1695290f70921a4064/users/c35f1943bdcc4de8aebf248448f65a06/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.802504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b02941368dd4f1695290f70921a4064, user_id=c35f1943bdcc4de8aebf248448f65a06, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.805185 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.817373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 651/1285] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:01.828772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 635/1286] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:01 2022] PUT /identity/v3/projects/4b02941368dd4f1695290f70921a4064/users/c35f1943bdcc4de8aebf248448f65a06/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:01.829540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2f6a-bf9a-4d7c-a6d6-8ce9b1da9176 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.829540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2f6a-bf9a-4d7c-a6d6-8ce9b1da9176 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.829540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2f6a-bf9a-4d7c-a6d6-8ce9b1da9176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.829831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:01.847901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d96f2f6a-bf9a-4d7c-a6d6-8ce9b1da9176 None None] MFA Rules not processed for user `7cfaf8a4dc1a40ee923e7ac9a4cc1fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:01.849135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d96f2f6a-bf9a-4d7c-a6d6-8ce9b1da9176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:01.879872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:01.881852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d598a8e-6ae0-4813-b16b-a26ac3208d0a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:01.885578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f6963-4f60-4b52-994c-37ea54b5ef7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:01.886220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6963-4f60-4b52-994c-37ea54b5ef7b service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.886506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6963-4f60-4b52-994c-37ea54b5ef7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.886782 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6963-4f60-4b52-994c-37ea54b5ef7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.914694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 652/1287] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:01.920100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c22ef9-7a76-4ec1-8342-2a34afd6ad2b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.920100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c22ef9-7a76-4ec1-8342-2a34afd6ad2b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.920100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c22ef9-7a76-4ec1-8342-2a34afd6ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.942159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-80c22ef9-7a76-4ec1-8342-2a34afd6ad2b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:01.942483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:01.943397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-80c22ef9-7a76-4ec1-8342-2a34afd6ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:01.963483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f6963-4f60-4b52-994c-37ea54b5ef7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:01.965479 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f6963-4f60-4b52-994c-37ea54b5ef7b service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:01.976294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 636/1288] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:01.977265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb96d-e61d-48d5-80ce-a1a7759cf95a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:01.977548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb96d-e61d-48d5-80ce-a1a7759cf95a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:01.977820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb96d-e61d-48d5-80ce-a1a7759cf95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:01.999970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-184eb96d-e61d-48d5-80ce-a1a7759cf95a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:02.001205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-184eb96d-e61d-48d5-80ce-a1a7759cf95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:02.014574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 653/1289] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:02.015844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d1de-df5a-4e65-b7a4-56fa5cf3d0f3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.016230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d1de-df5a-4e65-b7a4-56fa5cf3d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.016606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d1de-df5a-4e65-b7a4-56fa5cf3d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.042910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9e92d1de-df5a-4e65-b7a4-56fa5cf3d0f3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:02.044268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9e92d1de-df5a-4e65-b7a4-56fa5cf3d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:02.053357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 654/1290] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:02.054658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d1de-df5a-4e65-b7a4-56fa5cf3d0f3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.069903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d1de-df5a-4e65-b7a4-56fa5cf3d0f3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.076061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb251f-6b4c-4a94-80a3-e4ed224320da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.076726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb251f-6b4c-4a94-80a3-e4ed224320da admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.077026 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb251f-6b4c-4a94-80a3-e4ed224320da admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.077307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb251f-6b4c-4a94-80a3-e4ed224320da admin admin] PATH_INFO: `/v3/projects/2db881ccea4243f08123f6713356eda3/users/2bc73bc248a141ef80c838bac8ec5552/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.080747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 637/1291] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:02.081508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb96d-e61d-48d5-80ce-a1a7759cf95a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.098682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb251f-6b4c-4a94-80a3-e4ed224320da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db881ccea4243f08123f6713356eda3, user_id=2bc73bc248a141ef80c838bac8ec5552, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.102263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb251f-6b4c-4a94-80a3-e4ed224320da admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.127157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 655/1292] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:02 2022] PUT /identity/v3/projects/2db881ccea4243f08123f6713356eda3/users/2bc73bc248a141ef80c838bac8ec5552/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:02.127157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4506-54ad-45af-80e0-a02c39c3817b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.127157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4506-54ad-45af-80e0-a02c39c3817b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.127157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4506-54ad-45af-80e0-a02c39c3817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.151535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb96d-e61d-48d5-80ce-a1a7759cf95a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.157696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8ace4506-54ad-45af-80e0-a02c39c3817b None None] MFA Rules not processed for user `c35f1943bdcc4de8aebf248448f65a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:02.158927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8ace4506-54ad-45af-80e0-a02c39c3817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:02.207661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.208289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.208571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.208844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.246129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 656/1293] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:02.248399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040283e-9df7-4b89-9a02-48b7d015198a None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.248689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040283e-9df7-4b89-9a02-48b7d015198a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.248967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040283e-9df7-4b89-9a02-48b7d015198a None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.250255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 657/1294] 10.222.0.46 () {54 vars in 961 bytes} [Wed Oct 19 13:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:02.255697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040283e-9df7-4b89-9a02-48b7d015198a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.270241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040283e-9df7-4b89-9a02-48b7d015198a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.274512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186ceb0-bd9c-4903-965a-571539c73914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.275282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186ceb0-bd9c-4903-965a-571539c73914 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.275661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186ceb0-bd9c-4903-965a-571539c73914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.275819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186ceb0-bd9c-4903-965a-571539c73914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.290780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:02.305257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.306847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.310184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:02.320882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 638/1295] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:02.321829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.331535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8c0ee-3f5e-4c01-a603-b6a770b519ab service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.335820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.336555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.336942 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.337365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.350715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.352795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.356597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186ceb0-bd9c-4903-965a-571539c73914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.360649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186ceb0-bd9c-4903-965a-571539c73914 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.366414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 639/1296] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:02.367538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.376747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 658/1297] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:02.376916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a05f-9205-455d-beeb-feb27e36d060 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.378118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b610-2f89-4f1d-b90a-467dd50ea02f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.378412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b610-2f89-4f1d-b90a-467dd50ea02f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.378740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612b610-2f89-4f1d-b90a-467dd50ea02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.380992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa08c89-9a97-4ac2-b531-9caed05f467c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.381691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08c89-9a97-4ac2-b531-9caed05f467c service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.382044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08c89-9a97-4ac2-b531-9caed05f467c service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.382375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08c89-9a97-4ac2-b531-9caed05f467c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.394632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa08c89-9a97-4ac2-b531-9caed05f467c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.396324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa08c89-9a97-4ac2-b531-9caed05f467c service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.413969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 640/1298] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:02.416929 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2f28-b14c-4b9d-ae25-a7f36f30a373 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.417437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2f28-b14c-4b9d-ae25-a7f36f30a373 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.418096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2f28-b14c-4b9d-ae25-a7f36f30a373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.426484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d612b610-2f89-4f1d-b90a-467dd50ea02f None None] MFA Rules not processed for user `2bc73bc248a141ef80c838bac8ec5552`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:02.428042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d612b610-2f89-4f1d-b90a-467dd50ea02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:02.492447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d60d2f28-b14c-4b9d-ae25-a7f36f30a373 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:02.494269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d60d2f28-b14c-4b9d-ae25-a7f36f30a373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:02.529983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 659/1299] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:02.532053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aec8d-f47a-4c34-a49a-0745937e2738 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.532530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aec8d-f47a-4c34-a49a-0745937e2738 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.532855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aec8d-f47a-4c34-a49a-0745937e2738 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.534755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 660/1300] 10.222.0.46 () {54 vars in 961 bytes} [Wed Oct 19 13:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:02.540347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aec8d-f47a-4c34-a49a-0745937e2738 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.555956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aec8d-f47a-4c34-a49a-0745937e2738 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.565741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51bed5-a572-4f7e-82b4-0c259057b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.567139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bed5-a572-4f7e-82b4-0c259057b420 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.567931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bed5-a572-4f7e-82b4-0c259057b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.568262 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bed5-a572-4f7e-82b4-0c259057b420 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.570773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51bed5-a572-4f7e-82b4-0c259057b420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.574749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51bed5-a572-4f7e-82b4-0c259057b420 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.637679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 661/1301] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:02 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:24:02.637679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19f73-edd8-4885-9d74-861a99a1de0f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.637679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19f73-edd8-4885-9d74-861a99a1de0f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.637679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19f73-edd8-4885-9d74-861a99a1de0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.640720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 641/1302] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Oct 19 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:02.642420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d2f28-b14c-4b9d-ae25-a7f36f30a373 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.659724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d2f28-b14c-4b9d-ae25-a7f36f30a373 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.673482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-40f19f73-edd8-4885-9d74-861a99a1de0f None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:02.677127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-40f19f73-edd8-4885-9d74-861a99a1de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:02.736995 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.737677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.737959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.738239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.738917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.741964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.789347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 642/1303] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:02 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:02.790357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.799113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 662/1304] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Oct 19 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:02.800084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19f73-edd8-4885-9d74-861a99a1de0f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.809946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b7a31-7e4d-482e-b365-f38aa0f221e6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.816988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19f73-edd8-4885-9d74-861a99a1de0f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.819175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.820391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.820993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.821513 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.831143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.832223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.832793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.833302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.834298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.836989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.854313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 663/1305] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:02.856398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.873437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:02.877940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988d80-be88-4e85-9242-dd74dc49ced3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.886204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.887745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.888739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.888739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.903414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:02.912891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.915309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:02.927531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 643/1306] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:02.928768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:02.942042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae8722-3b31-4d76-bc60-414f8a36ffe0 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:02.952659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:02.954826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:02.955306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:02.955744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] PATH_INFO: `/v3/projects/b930fbb9ed0e49c381a81a1eae9ee59a/users/64228f8a5be346889e706b9770dfac78/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:02.987361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:02.989685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:03.002135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 664/1307] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:03.014634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b930fbb9ed0e49c381a81a1eae9ee59a, user_id=64228f8a5be346889e706b9770dfac78, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:03.018629 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:03.042383 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 644/1308] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:02 2022] PUT /identity/v3/projects/b930fbb9ed0e49c381a81a1eae9ee59a/users/64228f8a5be346889e706b9770dfac78/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:03.047099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:03.066577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e031-2869-4dd1-b7ee-9d268e953c05 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:03.139377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764b8f9-cdf6-44c4-8eb4-f468a4763dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:03.140290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764b8f9-cdf6-44c4-8eb4-f468a4763dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.140657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764b8f9-cdf6-44c4-8eb4-f468a4763dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.141789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764b8f9-cdf6-44c4-8eb4-f468a4763dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.142567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764b8f9-cdf6-44c4-8eb4-f468a4763dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:03.144825 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764b8f9-cdf6-44c4-8eb4-f468a4763dfe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:03.162865 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 665/1309] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:03.167809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:03.189335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fe162-82af-422f-b0d9-2baf846667ce admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:03.195719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d28fcc-f070-495d-9aa5-938d52ab0ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:03.197067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28fcc-f070-495d-9aa5-938d52ab0ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.197067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28fcc-f070-495d-9aa5-938d52ab0ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.197490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28fcc-f070-495d-9aa5-938d52ab0ac4 admin admin] PATH_INFO: `/v3/projects/b930fbb9ed0e49c381a81a1eae9ee59a/users/64228f8a5be346889e706b9770dfac78/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.204421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d28fcc-f070-495d-9aa5-938d52ab0ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b930fbb9ed0e49c381a81a1eae9ee59a, user_id=64228f8a5be346889e706b9770dfac78, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:03.211760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d28fcc-f070-495d-9aa5-938d52ab0ac4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:03.229363 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe17ab-c129-4c42-90ab-7d6c3dc2dc08 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.229944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe17ab-c129-4c42-90ab-7d6c3dc2dc08 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.230929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe17ab-c129-4c42-90ab-7d6c3dc2dc08 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.232213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 666/1310] 10.222.0.46 () {54 vars in 912 bytes} [Wed Oct 19 13:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:03.242230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 645/1311] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:03 2022] PUT /identity/v3/projects/b930fbb9ed0e49c381a81a1eae9ee59a/users/64228f8a5be346889e706b9770dfac78/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:03.247002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0826c4-a6d2-41a4-b496-9fb48d451350 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.247542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0826c4-a6d2-41a4-b496-9fb48d451350 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.247625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0826c4-a6d2-41a4-b496-9fb48d451350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.263669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeede8-95f5-4457-8b7a-36835405bbea None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.264705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeede8-95f5-4457-8b7a-36835405bbea None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.266008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeede8-95f5-4457-8b7a-36835405bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.297752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5b0826c4-a6d2-41a4-b496-9fb48d451350 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:03.301871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5b0826c4-a6d2-41a4-b496-9fb48d451350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:03.316487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-28eeede8-95f5-4457-8b7a-36835405bbea None None] MFA Rules not processed for user `64228f8a5be346889e706b9770dfac78`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:03.317763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-28eeede8-95f5-4457-8b7a-36835405bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:03.403174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 646/1312] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:03.419788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eeede8-95f5-4457-8b7a-36835405bbea None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:03.498917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 667/1313] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:03.539575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eeede8-95f5-4457-8b7a-36835405bbea None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:03.545690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae3dda-dfb3-498f-8676-7e9e59f7c2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:03.546756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3dda-dfb3-498f-8676-7e9e59f7c2fe service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.547043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3dda-dfb3-498f-8676-7e9e59f7c2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.547514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3dda-dfb3-498f-8676-7e9e59f7c2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.557306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0826c4-a6d2-41a4-b496-9fb48d451350 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:03.570778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0826c4-a6d2-41a4-b496-9fb48d451350 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:03.572691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae3dda-dfb3-498f-8676-7e9e59f7c2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:03.574713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae3dda-dfb3-498f-8676-7e9e59f7c2fe service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:03.575362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:03.576584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.576584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.576822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.585695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 647/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:03.587408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b660-fd93-442d-a3a6-5df76add0a37 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.587949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b660-fd93-442d-a3a6-5df76add0a37 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.588330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b660-fd93-442d-a3a6-5df76add0a37 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.590497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 648/1315] 10.222.0.46 () {54 vars in 912 bytes} [Wed Oct 19 13:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:03.592790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:03.595970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:03.596571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d24375-ee2b-4ea7-8bbc-0c5083d34098 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.596838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d24375-ee2b-4ea7-8bbc-0c5083d34098 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.597105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d24375-ee2b-4ea7-8bbc-0c5083d34098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.624402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 668/1316] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:03.650195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-15d24375-ee2b-4ea7-8bbc-0c5083d34098 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:03.654547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-15d24375-ee2b-4ea7-8bbc-0c5083d34098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:03.678868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 649/1317] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:03.725042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:03.734573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7640c-47d3-4c72-8cea-10de0ea6c12c service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:03.739106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:03.739736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:03.740014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:03.740289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:03.753443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:03.754928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:03.770408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 669/1318] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:05.721194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d24375-ee2b-4ea7-8bbc-0c5083d34098 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:05.740624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:05.847229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d24375-ee2b-4ea7-8bbc-0c5083d34098 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:05.853644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:05.854342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:05.854620 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:05.854924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] PATH_INFO: `/v3/users/2bc73bc248a141ef80c838bac8ec5552` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:05.857067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc73bc248a141ef80c838bac8ec5552)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:05.858323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: WARNING py.warnings [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:24:05.858323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: warnings.warn(msg) Oct 19 13:24:05.858323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: Oct 19 13:24:05.860139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:05.940379 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:05.955969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e86c-c523-47e6-ae53-c41e2d61a363 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:05.963741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:05.965342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:05.965732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:05.966110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] PATH_INFO: `/v3/users/b4897dca57b845a6827676bcfaea8461` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:05.967582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4897dca57b845a6827676bcfaea8461)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:05.969570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc73bc248a141ef80c838bac8ec5552'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:05.970268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc73bc248a141ef80c838bac8ec5552'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:05.971471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:05.984370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:05.992803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc73bc248a141ef80c838bac8ec5552'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.006580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc73bc248a141ef80c838bac8ec5552'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.040109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9a546e91-c7fa-440a-9940-feee7f2ddd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc73bc248a141ef80c838bac8ec5552'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.056772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 650/1319] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:05 2022] DELETE /identity/v3/users/2bc73bc248a141ef80c838bac8ec5552 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:06.059208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:06.060150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:06.061012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:06.087648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4897dca57b845a6827676bcfaea8461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.088417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4897dca57b845a6827676bcfaea8461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.089772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:06.091860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:06.104044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4897dca57b845a6827676bcfaea8461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.128023 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4897dca57b845a6827676bcfaea8461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.128772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-caa78a2e-a5b2-43d5-b694-18fd47be2d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4897dca57b845a6827676bcfaea8461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:06.169923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 670/1320] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:05 2022] DELETE /identity/v3/users/b4897dca57b845a6827676bcfaea8461 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:06.176358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:06.179376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:06.180467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:06.269360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:06.273052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:06.289769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 651/1321] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:06.345731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:06.355371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:06.413099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 671/1322] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:06.449617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:06.468886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:06.470540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:06.484649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e504-1095-4fc2-a8dc-9584b1493cd1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:06.631816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ee1bf-1336-4b01-96d1-a4261d10bcfc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:06.649933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:06.651291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:06.651629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:06.653044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:06.687774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:06.695776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:06.718105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdeece-244c-4153-90c3-fe1f6afb97b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:06.719384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeece-244c-4153-90c3-fe1f6afb97b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:06.719893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeece-244c-4153-90c3-fe1f6afb97b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:06.720912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeece-244c-4153-90c3-fe1f6afb97b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:06.734490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 672/1323] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:06.768169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdeece-244c-4153-90c3-fe1f6afb97b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:06.771118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdeece-244c-4153-90c3-fe1f6afb97b5 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:06.788687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 652/1324] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:07.835944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:07.835944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:07.853519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046c462-777f-4dba-9860-8176dbc5d47d service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:07.881328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:07.883365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:07.884951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:07.890850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] PATH_INFO: `/v3/users/7cfaf8a4dc1a40ee923e7ac9a4cc1fcd` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:07.893674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfaf8a4dc1a40ee923e7ac9a4cc1fcd)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:07.897393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:07.965512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:08.017211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfaf8a4dc1a40ee923e7ac9a4cc1fcd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.017928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfaf8a4dc1a40ee923e7ac9a4cc1fcd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.038185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfaf8a4dc1a40ee923e7ac9a4cc1fcd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.068288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfaf8a4dc1a40ee923e7ac9a4cc1fcd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.071557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfaf8a4dc1a40ee923e7ac9a4cc1fcd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.107897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:08.108523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:08.108821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:08.113299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 673/1325] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:07 2022] DELETE /identity/v3/users/7cfaf8a4dc1a40ee923e7ac9a4cc1fcd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:08.156240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:08.159403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:08.193720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:08.197143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:08.358534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af48c-4d34-4b35-8a03-0e6b118de6ad admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:08.367912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:08.368739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:08.369307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:08.369477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] PATH_INFO: `/v3/projects/2db881ccea4243f08123f6713356eda3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:08.374471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db881ccea4243f08123f6713356eda3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:08.376224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: WARNING py.warnings [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 19 13:24:08.376224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: warnings.warn(msg) Oct 19 13:24:08.376224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: Oct 19 13:24:08.378918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:08.477204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 653/1326] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:08.480477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:08.487037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:08.537409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4259a-d864-42c3-ac40-8f9aace3dcea None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:08.546776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db881ccea4243f08123f6713356eda3', 'request_id': 'req-871fdbae-7c64-4668-899c-0e6bcbe39fba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.582886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db881ccea4243f08123f6713356eda3', 'request_id': 'req-871fdbae-7c64-4668-899c-0e6bcbe39fba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.608093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db881ccea4243f08123f6713356eda3', 'request_id': 'req-871fdbae-7c64-4668-899c-0e6bcbe39fba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.632403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] The token cache is being invalidate because project 2db881ccea4243f08123f6713356eda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:08.632403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.633095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-871fdbae-7c64-4668-899c-0e6bcbe39fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.634950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 674/1327] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:08 2022] DELETE /identity/v3/projects/2db881ccea4243f08123f6713356eda3 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:08.638937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0863-d1f9-45d4-af77-cac79d9408e3 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:08.639274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0863-d1f9-45d4-af77-cac79d9408e3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:08.640351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc0863-d1f9-45d4-af77-cac79d9408e3 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:08.641604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 675/1328] 10.222.0.46 () {54 vars in 964 bytes} [Wed Oct 19 13:24:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:08.644457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0863-d1f9-45d4-af77-cac79d9408e3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:08.652362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e1bc0863-d1f9-45d4-af77-cac79d9408e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:08.703556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:08.705680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:08.711105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:08.711105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] PATH_INFO: `/v3/projects/1e33fa36c6364814a65e51fbb5497c90` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:08.735996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e33fa36c6364814a65e51fbb5497c90)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:08.740494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:08.748410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:08.807072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc0863-d1f9-45d4-af77-cac79d9408e3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:08.823899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:08.824136 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:08.824394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:08.824675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] PATH_INFO: `/v3/users/64228f8a5be346889e706b9770dfac78` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:08.825909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64228f8a5be346889e706b9770dfac78)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:08.827910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:08.849071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:08.873477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e33fa36c6364814a65e51fbb5497c90', 'request_id': 'req-298bae8b-2359-49ce-87c4-6b5000461e6b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.897056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e33fa36c6364814a65e51fbb5497c90', 'request_id': 'req-298bae8b-2359-49ce-87c4-6b5000461e6b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.920031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e33fa36c6364814a65e51fbb5497c90', 'request_id': 'req-298bae8b-2359-49ce-87c4-6b5000461e6b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.926082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64228f8a5be346889e706b9770dfac78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.926790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64228f8a5be346889e706b9770dfac78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.943382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64228f8a5be346889e706b9770dfac78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.949369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] The token cache is being invalidate because project 1e33fa36c6364814a65e51fbb5497c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:08.950085 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.952369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-298bae8b-2359-49ce-87c4-6b5000461e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.954842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 654/1329] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:08 2022] DELETE /identity/v3/projects/1e33fa36c6364814a65e51fbb5497c90 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:08.956473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1de40-23de-490b-ac9d-bd47e50b5e01 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:08.959457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1de40-23de-490b-ac9d-bd47e50b5e01 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:08.959989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1de40-23de-490b-ac9d-bd47e50b5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:08.975455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64228f8a5be346889e706b9770dfac78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:08.976202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64228f8a5be346889e706b9770dfac78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:09.004938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 676/1330] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:08 2022] DELETE /identity/v3/users/64228f8a5be346889e706b9770dfac78 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:09.012064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:09.013672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:09.068756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1ed1de40-23de-490b-ac9d-bd47e50b5e01 None None] MFA Rules not processed for user `9b0ffc12a2fe49938b8a5ab56cd9721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:09.070350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1ed1de40-23de-490b-ac9d-bd47e50b5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:09.193784 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7afc79-a0ec-4ef3-96c0-68430728c385 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:09.208879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:09.209549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:09.209836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:09.211197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] PATH_INFO: `/v3/users/933966e0ebf3441bae60634e69504e2f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:09.212655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=933966e0ebf3441bae60634e69504e2f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:09.215248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:09.220103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 655/1331] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Oct 19 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:09.242507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1de40-23de-490b-ac9d-bd47e50b5e01 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:09.256739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1de40-23de-490b-ac9d-bd47e50b5e01 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:09.278279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:09.279336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:09.279863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:09.281567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:09.300899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:09.326120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:09.328698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:09.357619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 656/1332] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:09.382999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933966e0ebf3441bae60634e69504e2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:09.384284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933966e0ebf3441bae60634e69504e2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:09.397787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:09.405216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933966e0ebf3441bae60634e69504e2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:09.436714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933966e0ebf3441bae60634e69504e2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:09.437495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-fe0cb2cb-63cb-4b85-b77f-791800dacaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933966e0ebf3441bae60634e69504e2f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:09.467297 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 677/1333] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:09 2022] DELETE /identity/v3/users/933966e0ebf3441bae60634e69504e2f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:11.105637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:11.107763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:11.130832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa4303-cc3d-47fa-a9b3-4a83ca2a8330 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:11.235545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:11.236592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:11.237095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:11.237572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] PATH_INFO: `/v3/users/c35f1943bdcc4de8aebf248448f65a06` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:11.238946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35f1943bdcc4de8aebf248448f65a06)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:11.241344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:11.313502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35f1943bdcc4de8aebf248448f65a06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.315160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35f1943bdcc4de8aebf248448f65a06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.317830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:11.331965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35f1943bdcc4de8aebf248448f65a06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.347249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35f1943bdcc4de8aebf248448f65a06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.385649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35f1943bdcc4de8aebf248448f65a06'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.410675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 657/1334] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:11 2022] DELETE /identity/v3/users/c35f1943bdcc4de8aebf248448f65a06 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:11.418530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:11.419132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:11.419132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:11.459887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:11.465684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:11.624810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 678/1335] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:11.643475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:11.645288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:11.660401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:11.661909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:11.687921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6344c-e96e-4b55-8a62-f82f42aff64a None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:11.701062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:11.703994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:11.704613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:11.704910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] PATH_INFO: `/v3/projects/548907bd223648189f8518193c83a506` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:11.707422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=548907bd223648189f8518193c83a506)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:11.716548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:11.803694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b446-930a-4880-90ef-258c89de47be admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:11.814869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:11.816031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:11.816542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:11.817812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:11.863686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:11.864550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548907bd223648189f8518193c83a506', 'request_id': 'req-04b7b3f2-8439-451d-9446-730d7a152082'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.867360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:11.879020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548907bd223648189f8518193c83a506', 'request_id': 'req-04b7b3f2-8439-451d-9446-730d7a152082'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.907398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548907bd223648189f8518193c83a506', 'request_id': 'req-04b7b3f2-8439-451d-9446-730d7a152082'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.914308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 658/1336] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:11.915550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:11.925885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:11.939052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] The token cache is being invalidate because project 548907bd223648189f8518193c83a506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:11.939245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.942817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:11.947145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 679/1337] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:11 2022] DELETE /identity/v3/projects/548907bd223648189f8518193c83a506 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:11.950512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:11.953445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:11.969453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eae58-4da1-4d56-9431-708f65df1d3e service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:12.091321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:12.131768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:12.132755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.133037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.133322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] PATH_INFO: `/v3/projects/b930fbb9ed0e49c381a81a1eae9ee59a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.133448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7b3f2-8439-451d-9446-730d7a152082 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:12.140077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b930fbb9ed0e49c381a81a1eae9ee59a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:12.142190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:12.149973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:12.150892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.152768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.156929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] PATH_INFO: `/v3/projects/cffb5e81fa3147d893302ee1c23abe9e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.162006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffb5e81fa3147d893302ee1c23abe9e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:12.169424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:12.260641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b930fbb9ed0e49c381a81a1eae9ee59a', 'request_id': 'req-bf53b329-77d1-401f-b358-32bc3c519af1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.273578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b930fbb9ed0e49c381a81a1eae9ee59a', 'request_id': 'req-bf53b329-77d1-401f-b358-32bc3c519af1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.298732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffb5e81fa3147d893302ee1c23abe9e', 'request_id': 'req-b5fe1eb8-7114-4867-92c9-1c982596f7f3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.299439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b930fbb9ed0e49c381a81a1eae9ee59a', 'request_id': 'req-bf53b329-77d1-401f-b358-32bc3c519af1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.308563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:12.316752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffb5e81fa3147d893302ee1c23abe9e', 'request_id': 'req-b5fe1eb8-7114-4867-92c9-1c982596f7f3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.317878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] The token cache is being invalidate because project b930fbb9ed0e49c381a81a1eae9ee59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:12.318334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.322082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bf53b329-77d1-401f-b358-32bc3c519af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.328153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 659/1338] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:11 2022] DELETE /identity/v3/projects/b930fbb9ed0e49c381a81a1eae9ee59a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:12.330052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffb5e81fa3147d893302ee1c23abe9e', 'request_id': 'req-b5fe1eb8-7114-4867-92c9-1c982596f7f3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.330607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758571-4a1a-4996-b204-3bd2846f8566 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.331997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758571-4a1a-4996-b204-3bd2846f8566 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.332533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758571-4a1a-4996-b204-3bd2846f8566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.360977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] The token cache is being invalidate because project cffb5e81fa3147d893302ee1c23abe9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:12.362290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.363564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b5fe1eb8-7114-4867-92c9-1c982596f7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:12.368432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 680/1339] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:11 2022] DELETE /identity/v3/projects/cffb5e81fa3147d893302ee1c23abe9e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:12.368616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d4758571-4a1a-4996-b204-3bd2846f8566 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:12.368717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ae72-a9f6-4514-8438-320a2890cb4a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.368717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ae72-a9f6-4514-8438-320a2890cb4a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.368877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d4758571-4a1a-4996-b204-3bd2846f8566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:12.369890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ae72-a9f6-4514-8438-320a2890cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.424286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9ba1ae72-a9f6-4514-8438-320a2890cb4a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:12.426864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9ba1ae72-a9f6-4514-8438-320a2890cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:12.516366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 660/1340] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:12.516366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22127da-59b9-4a92-b610-8feb56b3edd0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.516366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22127da-59b9-4a92-b610-8feb56b3edd0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.516366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22127da-59b9-4a92-b610-8feb56b3edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.541210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 681/1341] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:12.543910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2d6d-7079-45e7-a4d8-f401c41c7e54 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.546826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2d6d-7079-45e7-a4d8-f401c41c7e54 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.548024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2d6d-7079-45e7-a4d8-f401c41c7e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.561330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f22127da-59b9-4a92-b610-8feb56b3edd0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:12.564137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f22127da-59b9-4a92-b610-8feb56b3edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:12.602733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 661/1342] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:12.609421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c1a7-9fe0-4852-b818-78594bdb06cd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.610758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c1a7-9fe0-4852-b818-78594bdb06cd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.611454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c1a7-9fe0-4852-b818-78594bdb06cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.615037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c4ec2d6d-7079-45e7-a4d8-f401c41c7e54 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:12.616334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c4ec2d6d-7079-45e7-a4d8-f401c41c7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:12.639866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 682/1343] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:12.643332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7833-0e46-4fa4-9f70-eaa19e74279d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.643332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7833-0e46-4fa4-9f70-eaa19e74279d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.643332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7833-0e46-4fa4-9f70-eaa19e74279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.660456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4274c1a7-9fe0-4852-b818-78594bdb06cd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:12.665090 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4274c1a7-9fe0-4852-b818-78594bdb06cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:12.687582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 662/1344] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:12.690845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274c1a7-9fe0-4852-b818-78594bdb06cd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:12.692957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-250e7833-0e46-4fa4-9f70-eaa19e74279d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:12.697635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-250e7833-0e46-4fa4-9f70-eaa19e74279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:12.711440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274c1a7-9fe0-4852-b818-78594bdb06cd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:12.718666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 683/1345] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:12.718666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e7833-0e46-4fa4-9f70-eaa19e74279d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:12.723480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:12.725691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.725999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.726466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.729025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:12.731337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:12.733083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:12.749878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e7833-0e46-4fa4-9f70-eaa19e74279d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:12.763653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:12.764291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.764574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.764847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.770201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:12.771064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:12.774193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:12.776615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 663/1346] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:12.781627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:12.799008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 684/1347] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:12.802453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91ebd3-8666-4a7f-b968-bcf92ae066e9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:12.804678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:12.809282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:12.810125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.810705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.823623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.829082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:12.829415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:12.835362 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:12.835620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32e65-e086-4bec-9f80-0c096b812bbe admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:12.847284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:12.849772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:12.850330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:12.850769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:12.851764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:12.855698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:12.872074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 664/1348] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:12.878473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:12.906329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ceb65-4274-4162-b859-9181541faca6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:12.908415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 685/1349] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:12.912351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.003690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:13.039536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.040174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.040458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.040734 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.041633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.043963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.055788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d424c-fb16-4eb5-a712-5cf8aa0bdb42 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.067632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.068304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.068590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.068867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.069519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.073118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.118441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 665/1350] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:13.118441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.140804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 686/1351] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:12 2022] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:13.143327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.236792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:13.277385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fb1f0-db36-45ae-9de9-260ae4a423f3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.288619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.289314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.289604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.291864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.293155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.299436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.301706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460b384-a6ea-4918-b677-10a6732c2d59 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.313741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.314392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.314719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.314997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.315680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.319355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.347337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 666/1352] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:13 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:13.347337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.375635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 687/1353] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:13 2022] POST /identity/v3/users => generated 282 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:13.375861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.376322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64fcf-5bbc-4301-8195-0e1e09df1713 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.387563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.389422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.389756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.391711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.392486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.398799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.399907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20003c0-4a72-476c-9147-a61ea37fec6c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.418638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.428384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.428951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.428951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.433828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.435864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.452447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 688/1354] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:13.453246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.465167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 667/1355] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:13 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:13.468074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.471059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:13.501083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff0139-1602-4384-8a03-97a6b5053480 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.518079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98434d9-d296-4d06-b929-ba092edcfe2c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.518761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.521678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.522338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.523264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.524801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.534505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.536030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.543258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.543685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.544749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] PATH_INFO: `/v3/projects/4b02941368dd4f1695290f70921a4064` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.548034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b02941368dd4f1695290f70921a4064)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.553045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.572957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 689/1356] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:13.574579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.612237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94be27-3f56-4591-9977-c389166cddae admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.630579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.632784 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.634498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.634909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.639454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.641220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.678101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 690/1357] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:13.678101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.698317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b02941368dd4f1695290f70921a4064', 'request_id': 'req-9eec3c56-def9-43fe-9e73-843a772b9ca9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:13.701476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816f6cd-b701-43c2-be41-a7207503839d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.709776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b02941368dd4f1695290f70921a4064', 'request_id': 'req-9eec3c56-def9-43fe-9e73-843a772b9ca9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:13.725135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b02941368dd4f1695290f70921a4064', 'request_id': 'req-9eec3c56-def9-43fe-9e73-843a772b9ca9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:13.755927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] The token cache is being invalidate because project 4b02941368dd4f1695290f70921a4064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:13.756521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:13.757402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:13.759912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 668/1358] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:13 2022] DELETE /identity/v3/projects/4b02941368dd4f1695290f70921a4064 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:13.762262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.764776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:13.863589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.865708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.866115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.866573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.869021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.874096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.899659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 691/1359] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:13.901416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:13.907817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:13.938430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c2ddd-d91b-4d97-8301-3ef484041dc7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.954401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.955041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec3c56-def9-43fe-9e73-843a772b9ca9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:13.955533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.956081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.956479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] PATH_INFO: `/v3/projects/5c6b483084724ac7b2557007b723b99a/users/b5866b2ba9a840bdb011594850265dc8/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.965523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822921d-103b-40dc-be54-fd3a0c2150aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:13.966274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822921d-103b-40dc-be54-fd3a0c2150aa admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.966568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822921d-103b-40dc-be54-fd3a0c2150aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.966938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822921d-103b-40dc-be54-fd3a0c2150aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.967636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822921d-103b-40dc-be54-fd3a0c2150aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:13.970509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822921d-103b-40dc-be54-fd3a0c2150aa admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:13.986831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 669/1360] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:13.988528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:13.988878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:13.989162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:13.998747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:14.013550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6b483084724ac7b2557007b723b99a, user_id=b5866b2ba9a840bdb011594850265dc8, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:14.016566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:14.016795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:14.020010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:14.037715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 670/1361] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:14.037715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:14.037715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:14.051283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 692/1362] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:13 2022] PUT /identity/v3/projects/5c6b483084724ac7b2557007b723b99a/users/b5866b2ba9a840bdb011594850265dc8/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:14.052087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:14.054527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f393a-366c-46e7-a7b8-4a53bf274c11 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:14.099115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:14.185808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0550828-7405-4cb9-b368-ee875faed2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:14.186585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550828-7405-4cb9-b368-ee875faed2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.186983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550828-7405-4cb9-b368-ee875faed2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.187451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550828-7405-4cb9-b368-ee875faed2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.188579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0550828-7405-4cb9-b368-ee875faed2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:14.190077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0550828-7405-4cb9-b368-ee875faed2d9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:14.217729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 671/1363] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:14.219438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096303-b105-4d9a-ac78-207fb7c2fecd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.219821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096303-b105-4d9a-ac78-207fb7c2fecd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.220213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096303-b105-4d9a-ac78-207fb7c2fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.227653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7e60-5c60-437a-a8b4-d0289803aed3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:14.253834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:14.254774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.255195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.255587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] PATH_INFO: `/v3/projects/09d2b7d0debf452f9bfa8a88c5aaf54c/users/5755364561b14989adc673c07938341c/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.268932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3e096303-b105-4d9a-ac78-207fb7c2fecd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:14.270395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3e096303-b105-4d9a-ac78-207fb7c2fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:14.289195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d2b7d0debf452f9bfa8a88c5aaf54c, user_id=5755364561b14989adc673c07938341c, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:14.292751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:14.302927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 672/1364] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:14.304637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b349c0-8f12-41dd-b2c0-e3f06cc9e3cf None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.306846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b349c0-8f12-41dd-b2c0-e3f06cc9e3cf None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.307380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b349c0-8f12-41dd-b2c0-e3f06cc9e3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.326540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 693/1365] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:14 2022] PUT /identity/v3/projects/09d2b7d0debf452f9bfa8a88c5aaf54c/users/5755364561b14989adc673c07938341c/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:14.327843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:14.349549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-50b349c0-8f12-41dd-b2c0-e3f06cc9e3cf None None] MFA Rules not processed for user `b5866b2ba9a840bdb011594850265dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:14.351041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-50b349c0-8f12-41dd-b2c0-e3f06cc9e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:14.448325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed9ee5-462b-4d79-a405-ea000c2d4de6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:14.463741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028f8a-9843-4eef-ba8c-60e9b02a941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:14.465523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028f8a-9843-4eef-ba8c-60e9b02a941c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.466062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028f8a-9843-4eef-ba8c-60e9b02a941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.467383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028f8a-9843-4eef-ba8c-60e9b02a941c admin admin] PATH_INFO: `/v3/projects/718682024e81459db85e96234d32a8da/users/837353c51edc4e07a19b09fd4861468e/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.486485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 673/1366] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:14.487060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b349c0-8f12-41dd-b2c0-e3f06cc9e3cf None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:14.503031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028f8a-9843-4eef-ba8c-60e9b02a941c admin admin] RBAC: Authorizing `identity:create_grant(project_id=718682024e81459db85e96234d32a8da, user_id=837353c51edc4e07a19b09fd4861468e, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:14.508391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028f8a-9843-4eef-ba8c-60e9b02a941c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:14.514630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b349c0-8f12-41dd-b2c0-e3f06cc9e3cf None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:14.522328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:14.523218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.523658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.524085 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.534991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 694/1367] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:14 2022] PUT /identity/v3/projects/718682024e81459db85e96234d32a8da/users/837353c51edc4e07a19b09fd4861468e/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:14.535231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:14.535685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:14.537506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:14.538718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dee36-1421-4876-bbfb-bdfc21107a15 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.541086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dee36-1421-4876-bbfb-bdfc21107a15 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.541474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dee36-1421-4876-bbfb-bdfc21107a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.575204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 674/1368] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:14.575204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:14.599442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71804fc-e1a1-40f1-a63d-f292e807eccf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:14.604517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-806dee36-1421-4876-bbfb-bdfc21107a15 None None] MFA Rules not processed for user `5755364561b14989adc673c07938341c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:14.606767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-806dee36-1421-4876-bbfb-bdfc21107a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:14.717949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:14.726345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:14.739387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.740500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.744407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.746058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:14.750012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:14.757423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 695/1369] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:14.759012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7b9a9-f657-4eec-bc1e-43c4458ca013 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:14.759438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7b9a9-f657-4eec-bc1e-43c4458ca013 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:14.759780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7b9a9-f657-4eec-bc1e-43c4458ca013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:14.815398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 675/1370] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:14 2022] POST /identity/v3/projects => generated 365 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:14.816552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:14.817605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f7f7b9a9-f657-4eec-bc1e-43c4458ca013 None None] MFA Rules not processed for user `837353c51edc4e07a19b09fd4861468e`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:14.820853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f7f7b9a9-f657-4eec-bc1e-43c4458ca013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:14.869188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:14.981827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7900f-cd0a-401b-bde5-8f6124d5b7f3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:14.988058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 696/1371] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:14.992757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7b9a9-f657-4eec-bc1e-43c4458ca013 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:14.998371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:14.999770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.000124 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.000463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.001214 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.006079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.007802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7b9a9-f657-4eec-bc1e-43c4458ca013 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.015575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400eb1-621a-4e7b-aa74-22dafb4e0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.016673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400eb1-621a-4e7b-aa74-22dafb4e0738 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.016958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400eb1-621a-4e7b-aa74-22dafb4e0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.017230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400eb1-621a-4e7b-aa74-22dafb4e0738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.022187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400eb1-621a-4e7b-aa74-22dafb4e0738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.027258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400eb1-621a-4e7b-aa74-22dafb4e0738 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.071728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 676/1372] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:14 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:15.073828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.109148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 697/1373] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:14 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:15.112660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.112963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.113241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.216722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] MFA Rules not processed for user `5d55946aecd64ff88095e59d6ec03c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:15.218033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:15.267219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57ffb-da2a-497e-97fe-e676b1ed4d3b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.400375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 698/1374] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:15.402800 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.403954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.403954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.404227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.404878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.407582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.413173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.418079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:15.458784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 677/1375] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:15 2022] POST /identity/v3/users => generated 289 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:15.459789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.483054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6dce5-4c94-4337-8c0b-6ce68e0be729 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.497236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.497880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.498575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.498872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.499560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.508073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.555679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 678/1376] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:15 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:15.556528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.562951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:15.589384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5a42e-04a2-4aa4-9c29-6759dc5a323d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.599746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ada64-8bff-48f8-8ef4-2f8b0cc16152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.601561 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ada64-8bff-48f8-8ef4-2f8b0cc16152 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.602983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ada64-8bff-48f8-8ef4-2f8b0cc16152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.603433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ada64-8bff-48f8-8ef4-2f8b0cc16152 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.604205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ada64-8bff-48f8-8ef4-2f8b0cc16152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.607245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ada64-8bff-48f8-8ef4-2f8b0cc16152 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.640340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 679/1377] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:15 2022] POST /identity/v3/users => generated 289 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:15.640585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79e339-8cd5-4923-ad72-fd11ace28812 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.640702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750eac-3ab1-42c5-8e71-5e84037dca0b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.640702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750eac-3ab1-42c5-8e71-5e84037dca0b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.640702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750eac-3ab1-42c5-8e71-5e84037dca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.653238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.653885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.654167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.654437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.657743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:15.669568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4e750eac-3ab1-42c5-8e71-5e84037dca0b None None] MFA Rules not processed for user `5d55946aecd64ff88095e59d6ec03c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:15.671199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4e750eac-3ab1-42c5-8e71-5e84037dca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:15.690032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 680/1378] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:15.695373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750eac-3ab1-42c5-8e71-5e84037dca0b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.733870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750eac-3ab1-42c5-8e71-5e84037dca0b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.748785 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.749612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.750007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.750390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.751186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.757704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.784616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 681/1379] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:15.786007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.804510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.806542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.811754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4e29-5ce6-4400-8949-6a53d90fefe3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.827738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.827738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.828861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.829149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.829823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.831512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.833107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 699/1380] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:15.850537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.861390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 682/1381] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:15.861959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.864577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:15.882399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00868fd-f11c-4722-9322-14cc79fcb275 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.885797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe02d7-ab04-4af3-8fca-a8e7833d9eb6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.894187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.896490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.896490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.896490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.897976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.897976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.897976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.897976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.902536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.902536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.906898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.909466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:15.925510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 683/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:15.939921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.944083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 700/1383] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:15.945057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:15.966903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc59b-1293-41ae-b393-51317f45837e service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.969435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63559a37-f8d0-4ed4-8cbb-f7cb890eab34 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:15.983915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0675e-6959-4331-bdc0-c015f2a8b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.984756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0675e-6959-4331-bdc0-c015f2a8b09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.985351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0675e-6959-4331-bdc0-c015f2a8b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.985691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0675e-6959-4331-bdc0-c015f2a8b09d admin admin] PATH_INFO: `/v3/projects/cb9fb2d3b4774e7fa6d9757d0fe2c0ba/users/e2338167ade349008a5137189b1c080f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.993388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:15.994293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:15.994293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:15.994613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:15.996441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:15.998119 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:16.038400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 701/1384] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:16.039305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:16.073195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdae9-c7b1-4a6b-99ea-c3ad6a2ce7a4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:16.093739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:16.097573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.103464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.103935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] PATH_INFO: `/v3/projects/6b29275524df47f692eca76251047d99/users/d1883327df87414eb5d953723847249b/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.178008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b29275524df47f692eca76251047d99, user_id=d1883327df87414eb5d953723847249b, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:16.190107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:16.226549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 702/1385] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:16 2022] PUT /identity/v3/projects/6b29275524df47f692eca76251047d99/users/d1883327df87414eb5d953723847249b/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:16.240819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:16.296680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0675e-6959-4331-bdc0-c015f2a8b09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9fb2d3b4774e7fa6d9757d0fe2c0ba, user_id=e2338167ade349008a5137189b1c080f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:16.302692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0675e-6959-4331-bdc0-c015f2a8b09d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:16.348152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 684/1386] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:15 2022] PUT /identity/v3/projects/cb9fb2d3b4774e7fa6d9757d0fe2c0ba/users/e2338167ade349008a5137189b1c080f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:16.349451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6dd72-77b4-4998-a7ac-0c61e17f40a8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.351917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6dd72-77b4-4998-a7ac-0c61e17f40a8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.352217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6dd72-77b4-4998-a7ac-0c61e17f40a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.398999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e6d1-4ee4-4f34-9d4e-43a4b9528249 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:16.429622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b4e6dd72-77b4-4998-a7ac-0c61e17f40a8 None None] MFA Rules not processed for user `6f35b75b70c141be869554ef0e30e21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:16.431970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b4e6dd72-77b4-4998-a7ac-0c61e17f40a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:16.483932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:16.525935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:16.527421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.527705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.527977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] PATH_INFO: `/v3/projects/8d795e9877894f668476e5d6f2b5ec5d/users/006aa835fc4e46b78befb80aef9669d5/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.568496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 685/1387] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:16.569537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6dd72-77b4-4998-a7ac-0c61e17f40a8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:16.578662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d795e9877894f668476e5d6f2b5ec5d, user_id=006aa835fc4e46b78befb80aef9669d5, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:16.581618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:16.588787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6dd72-77b4-4998-a7ac-0c61e17f40a8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:16.595233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:16.595996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.596292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.596605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.597320 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:16.599619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:16.613140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 703/1388] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:16 2022] PUT /identity/v3/projects/8d795e9877894f668476e5d6f2b5ec5d/users/006aa835fc4e46b78befb80aef9669d5/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:16.613999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:16.624829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 686/1389] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:16.625836 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:16.639042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9a401-6336-4d36-87a9-ebc157e19ab4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:16.722963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6829b-2204-49fd-892b-8a3fd574e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:16.723654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6829b-2204-49fd-892b-8a3fd574e8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.723936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6829b-2204-49fd-892b-8a3fd574e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.724353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6829b-2204-49fd-892b-8a3fd574e8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.725030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6829b-2204-49fd-892b-8a3fd574e8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:16.727761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6829b-2204-49fd-892b-8a3fd574e8bb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:16.744205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 687/1390] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:16.744205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9baf76-4395-4dda-8292-4e3ea08e1bb3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.744205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9baf76-4395-4dda-8292-4e3ea08e1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.744205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9baf76-4395-4dda-8292-4e3ea08e1bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.759446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76515588-a182-415b-8f3a-41ffb3e74f2f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:16.768691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7f9baf76-4395-4dda-8292-4e3ea08e1bb3 None None] MFA Rules not processed for user `6f35b75b70c141be869554ef0e30e21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:16.769948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7f9baf76-4395-4dda-8292-4e3ea08e1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:16.779774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:16.780435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.780713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.780953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:16.781065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] PATH_INFO: `/v3/users/837353c51edc4e07a19b09fd4861468e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.782126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=837353c51edc4e07a19b09fd4861468e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:16.784321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:16.923816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 688/1391] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:16.925458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:16.925916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:16.926346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:16.948043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837353c51edc4e07a19b09fd4861468e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:16.949995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837353c51edc4e07a19b09fd4861468e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:16.965643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837353c51edc4e07a19b09fd4861468e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:16.986781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] MFA Rules not processed for user `006aa835fc4e46b78befb80aef9669d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:16.988270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:16.998036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837353c51edc4e07a19b09fd4861468e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:17.000592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837353c51edc4e07a19b09fd4861468e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:17.030671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 704/1392] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:16 2022] DELETE /identity/v3/users/837353c51edc4e07a19b09fd4861468e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:17.031559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:17.033576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:17.140282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 689/1393] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:17.141365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:17.146432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:17.176759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:17.187586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17f1d-c2f5-445a-9a8e-1e1ee6450fe3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:17.234675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d579f37-534e-40a6-8428-1c5d589448fc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:17.246856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:17.247920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.247920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.248154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] PATH_INFO: `/v3/projects/6b29275524df47f692eca76251047d99/users/d1883327df87414eb5d953723847249b/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.256091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b29275524df47f692eca76251047d99, user_id=d1883327df87414eb5d953723847249b, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:17.264708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:17.290055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 705/1394] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:17 2022] PUT /identity/v3/projects/6b29275524df47f692eca76251047d99/users/d1883327df87414eb5d953723847249b/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:17.290610 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:17.294050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:17.352254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042ab9b-1dbc-41b2-b1a8-b4c76a78dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:17.352839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ab9b-1dbc-41b2-b1a8-b4c76a78dfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.354745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ab9b-1dbc-41b2-b1a8-b4c76a78dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.354745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ab9b-1dbc-41b2-b1a8-b4c76a78dfbf admin admin] PATH_INFO: `/v3/projects/cb9fb2d3b4774e7fa6d9757d0fe2c0ba/users/e2338167ade349008a5137189b1c080f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.361963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042ab9b-1dbc-41b2-b1a8-b4c76a78dfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9fb2d3b4774e7fa6d9757d0fe2c0ba, user_id=e2338167ade349008a5137189b1c080f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:17.364921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042ab9b-1dbc-41b2-b1a8-b4c76a78dfbf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:17.392594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 690/1395] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:17 2022] PUT /identity/v3/projects/cb9fb2d3b4774e7fa6d9757d0fe2c0ba/users/e2338167ade349008a5137189b1c080f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:17.394289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2643e-d713-4f7b-aa94-43711945cb4f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.394686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2643e-d713-4f7b-aa94-43711945cb4f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.395987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2643e-d713-4f7b-aa94-43711945cb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.444375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2aa2643e-d713-4f7b-aa94-43711945cb4f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:17.447386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2aa2643e-d713-4f7b-aa94-43711945cb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:17.477515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378b8f-608b-4180-a9c9-dbd702f2e56f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:17.584055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:17.630234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 691/1396] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:17.633337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8016b-3e80-494a-a94d-af07008109b7 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.633844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8016b-3e80-494a-a94d-af07008109b7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.634350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8016b-3e80-494a-a94d-af07008109b7 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.639630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d748-d885-4608-9988-3a93dcde6dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:17.642064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d748-d885-4608-9988-3a93dcde6dc8 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.642360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d748-d885-4608-9988-3a93dcde6dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.642641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d748-d885-4608-9988-3a93dcde6dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.644932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 692/1397] 10.222.0.46 () {54 vars in 912 bytes} [Wed Oct 19 13:24:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:17.645999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8016b-3e80-494a-a94d-af07008109b7 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:17.647757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-90d3d748-d885-4608-9988-3a93dcde6dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:17.651589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7fb8016b-3e80-494a-a94d-af07008109b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:17.787294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8016b-3e80-494a-a94d-af07008109b7 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:17.795111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e4eef-8994-4bc5-acf1-b0e029030757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:17.796289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4eef-8994-4bc5-acf1-b0e029030757 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.796917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4eef-8994-4bc5-acf1-b0e029030757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.797299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4eef-8994-4bc5-acf1-b0e029030757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.823780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d748-d885-4608-9988-3a93dcde6dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:17.825485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d748-d885-4608-9988-3a93dcde6dc8 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:17.853457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 706/1398] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:17.863474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4197a-b94e-4d56-a904-ec76992b0ba0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.863835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4197a-b94e-4d56-a904-ec76992b0ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.864113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4197a-b94e-4d56-a904-ec76992b0ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.941939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:17.943364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e4eef-8994-4bc5-acf1-b0e029030757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:17.945205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e4eef-8994-4bc5-acf1-b0e029030757 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:17.969132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 693/1399] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:17.970972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:17.973878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:17.974309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:17.990509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-55f4197a-b94e-4d56-a904-ec76992b0ba0 None None] MFA Rules not processed for user `d1883327df87414eb5d953723847249b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:17.991786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-55f4197a-b94e-4d56-a904-ec76992b0ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:18.071208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] MFA Rules not processed for user `e2338167ade349008a5137189b1c080f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:18.076696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:18.272277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 707/1400] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:18.275157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:18.279254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:18.279687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:18.299767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 694/1401] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:18.305423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:18.310809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] MFA Rules not processed for user `9b0ffc12a2fe49938b8a5ab56cd9721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:18.312396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:18.314200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:18.381492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:18.463470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 708/1402] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:24:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:18.468300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3478f4-dd6b-4ed1-a17a-8a1985ff038c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:18.470264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:18.472860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:18.504223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:18.504928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:18.505273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:18.505502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:18.530145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:18.531483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0380655-dbce-4b26-8061-853fcdcab3c8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:18.533192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:18.537634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:18.538586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:18.539009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:18.539454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:18.584283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:18.592149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 695/1403] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:18.606445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:18.639650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 709/1404] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:18.700841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:18.715895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176dbc-f76c-4d7e-9300-7d8da25d9199 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:18.733613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:18.734351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:18.734740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:18.735143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:18.766940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:18.772527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:18.814594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 696/1405] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:18.952940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:18.963016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799a958-bb95-4772-addd-901a4058c2ed service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:18.978279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:18.979215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:18.979350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:18.979610 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:18.997701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:19.052640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:19.065197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ed0b2-6c07-4b99-984d-6cd039da657d service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:19.073140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10319958-d6d8-4d9a-b822-1e8b5049ec5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:19.074281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319958-d6d8-4d9a-b822-1e8b5049ec5d service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:19.074556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319958-d6d8-4d9a-b822-1e8b5049ec5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:19.074823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319958-d6d8-4d9a-b822-1e8b5049ec5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:19.087165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-10319958-d6d8-4d9a-b822-1e8b5049ec5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:19.189682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:19.193048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:19.223905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 710/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:19.226553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:19.242228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10319958-d6d8-4d9a-b822-1e8b5049ec5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:19.243988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10319958-d6d8-4d9a-b822-1e8b5049ec5d service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:19.275117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 697/1407] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:19.275956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60005684-dbab-4206-9a27-7da600b64960 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:19.283191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f131e-0d4c-44af-bf04-ab6234320e5f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:19.284090 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f131e-0d4c-44af-bf04-ab6234320e5f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:19.285472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f131e-0d4c-44af-bf04-ab6234320e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:19.286305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b645b-e5ba-4b6d-969d-89f083b6aaba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:19.286943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b645b-e5ba-4b6d-969d-89f083b6aaba service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:19.287259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b645b-e5ba-4b6d-969d-89f083b6aaba service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:19.287534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b645b-e5ba-4b6d-969d-89f083b6aaba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:19.311836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b645b-e5ba-4b6d-969d-89f083b6aaba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:19.313742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b645b-e5ba-4b6d-969d-89f083b6aaba service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:19.335221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 711/1408] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:19.392075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2c5f131e-0d4c-44af-bf04-ab6234320e5f None None] MFA Rules not processed for user `8f85c5d88c324fd790b6282e714861de`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:19.395074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2c5f131e-0d4c-44af-bf04-ab6234320e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:19.620877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 698/1409] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:19.692640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06e0e4-8ed7-4f30-9cfc-0cac978c460c None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:19.693664 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06e0e4-8ed7-4f30-9cfc-0cac978c460c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:19.693953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06e0e4-8ed7-4f30-9cfc-0cac978c460c None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:19.696593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 712/1410] 10.222.0.46 () {54 vars in 912 bytes} [Wed Oct 19 13:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 19 13:24:19.703620 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:19.704021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:19.704465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:19.786657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] MFA Rules not processed for user `9b0ffc12a2fe49938b8a5ab56cd9721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:19.788326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:19.799510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 699/1411] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:24:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:20.143574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06e0e4-8ed7-4f30-9cfc-0cac978c460c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:20.158964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06e0e4-8ed7-4f30-9cfc-0cac978c460c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:20.165771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d17988-0d9b-4073-b7f3-a51d54d6affd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:20.175740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d17988-0d9b-4073-b7f3-a51d54d6affd service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:20.176314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d17988-0d9b-4073-b7f3-a51d54d6affd service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:20.176847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d17988-0d9b-4073-b7f3-a51d54d6affd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:20.226210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d17988-0d9b-4073-b7f3-a51d54d6affd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:20.237335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d17988-0d9b-4073-b7f3-a51d54d6affd service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:20.311012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 713/1412] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:20.430662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:20.434831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:20.454711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc8af-c1dc-475e-b7aa-49d3e071abe9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:20.466929 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:20.467636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:20.467912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:20.468181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] PATH_INFO: `/v3/projects/718682024e81459db85e96234d32a8da` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:20.469355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] RBAC: Authorizing `identity:delete_project(project_id=718682024e81459db85e96234d32a8da)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:20.471380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:20.537021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:20.561868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718682024e81459db85e96234d32a8da', 'request_id': 'req-289519e3-8f68-4057-a427-80ae2b54962a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:20.569569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718682024e81459db85e96234d32a8da', 'request_id': 'req-289519e3-8f68-4057-a427-80ae2b54962a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:20.591298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718682024e81459db85e96234d32a8da', 'request_id': 'req-289519e3-8f68-4057-a427-80ae2b54962a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:20.612081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] The token cache is being invalidate because project 718682024e81459db85e96234d32a8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:20.614892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:20.618487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:20.621652 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 700/1413] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:20 2022] DELETE /identity/v3/projects/718682024e81459db85e96234d32a8da => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:20.628292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5c59-1494-4aaa-9cf2-a9fdf37eb55d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:20.628594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5c59-1494-4aaa-9cf2-a9fdf37eb55d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:20.628878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5c59-1494-4aaa-9cf2-a9fdf37eb55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:20.647516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:20.687177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-631a5c59-1494-4aaa-9cf2-a9fdf37eb55d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:20.688430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-631a5c59-1494-4aaa-9cf2-a9fdf37eb55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:20.839802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:20.841926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:20.879850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 714/1414] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:20.893094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadbc7-8d6f-4eff-915a-3dc65e6ceeb1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:20.893619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadbc7-8d6f-4eff-915a-3dc65e6ceeb1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:20.894632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadbc7-8d6f-4eff-915a-3dc65e6ceeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:20.967134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-28eadbc7-8d6f-4eff-915a-3dc65e6ceeb1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:20.969666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-28eadbc7-8d6f-4eff-915a-3dc65e6ceeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:21.005384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 715/1415] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:21.013555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eadbc7-8d6f-4eff-915a-3dc65e6ceeb1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:21.037983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eadbc7-8d6f-4eff-915a-3dc65e6ceeb1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:21.055413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289519e3-8f68-4057-a427-80ae2b54962a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:21.065948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:21.066599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:21.067464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:21.069816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:21.070120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:21.070722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:21.071175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:21.071555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:21.071826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:21.072136 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:21.076185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:21.079049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:21.097698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 716/1416] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:21.098606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:21.103776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:21.241636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:21.243490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:21.271173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 701/1417] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:21.272434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:21.285915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cdc3f-93a4-4bcc-8d56-79a94374f253 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:21.300390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400034ea-f542-4696-a371-c84c411c0d9d service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:21.305253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:21.305974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:21.308294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:21.309619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:21.311399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:21.312242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:21.312657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:21.312997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:21.313715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:21.316338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:21.318207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:21.362768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:21.371463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:21.422792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 702/1418] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:21 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:21.425243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:21.447104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 717/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:21.652247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:21.781571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1bff-470f-4ed6-9495-07f433409bc8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:21.815887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:21.816682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:21.818069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:21.819596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:21.820400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:21.830858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:21.897293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 703/1420] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:21 2022] POST /identity/v3/users => generated 289 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:21.898202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:21.921176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6c264-a6ca-4871-acdc-19a9a19dda0b service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:21.943643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ed52e-46b0-4f69-aef8-fea8a143b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:21.947400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed52e-46b0-4f69-aef8-fea8a143b3db admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:21.949437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed52e-46b0-4f69-aef8-fea8a143b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:21.950606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed52e-46b0-4f69-aef8-fea8a143b3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:21.952454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed52e-46b0-4f69-aef8-fea8a143b3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:21.960142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed52e-46b0-4f69-aef8-fea8a143b3db admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:21.999307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 718/1421] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:22.003270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:22.008863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715652-ae38-4518-a3ca-602310d4037e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:22.011589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715652-ae38-4518-a3ca-602310d4037e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:22.012029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715652-ae38-4518-a3ca-602310d4037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:22.017667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2ba95-692e-4017-90c4-cdd7c19bee56 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:22.037898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:22.038778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:22.043184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:22.044458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:22.046242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:22.049215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:22.071848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 704/1422] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:22.073045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:22.085094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5a7da-3b02-4041-ba8e-08dde814c235 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:22.091297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7c6e-f3fe-4920-8d42-b720f51230a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:22.092321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7c6e-f3fe-4920-8d42-b720f51230a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:22.092810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7c6e-f3fe-4920-8d42-b720f51230a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:22.093288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7c6e-f3fe-4920-8d42-b720f51230a3 admin admin] PATH_INFO: `/v3/projects/0b086564ac37461eb775008090aa1381/users/fe09b929f2654007a87ca55f4fd4d1b3/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:22.126721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7c6e-f3fe-4920-8d42-b720f51230a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b086564ac37461eb775008090aa1381, user_id=fe09b929f2654007a87ca55f4fd4d1b3, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:22.129158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1e715652-ae38-4518-a3ca-602310d4037e None None] MFA Rules not processed for user `30c408bc33b84cadb1b16ac2327011d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:22.130668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1e715652-ae38-4518-a3ca-602310d4037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:22.133022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7c6e-f3fe-4920-8d42-b720f51230a3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:22.181614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 705/1423] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:22 2022] PUT /identity/v3/projects/0b086564ac37461eb775008090aa1381/users/fe09b929f2654007a87ca55f4fd4d1b3/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:22.183731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ce27-89f9-4c22-8a49-657e535cce3c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:22.187916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ce27-89f9-4c22-8a49-657e535cce3c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:22.188206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035ce27-89f9-4c22-8a49-657e535cce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:22.266240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:22.293331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 719/1424] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:22.310935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e715652-ae38-4518-a3ca-602310d4037e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:22.326237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7035ce27-89f9-4c22-8a49-657e535cce3c None None] MFA Rules not processed for user `fe09b929f2654007a87ca55f4fd4d1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:22.331767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7035ce27-89f9-4c22-8a49-657e535cce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:22.467070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 706/1425] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:22.469147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71c0d-9880-4216-a373-269447a80753 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:22.469612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71c0d-9880-4216-a373-269447a80753 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:22.470641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71c0d-9880-4216-a373-269447a80753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:22.497175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-aaa71c0d-9880-4216-a373-269447a80753 None None] MFA Rules not processed for user `6f35b75b70c141be869554ef0e30e21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:22.499535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aaa71c0d-9880-4216-a373-269447a80753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:22.544549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e715652-ae38-4518-a3ca-602310d4037e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:22.733593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 707/1426] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:22.735177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71c0d-9880-4216-a373-269447a80753 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:22.772722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:22.796726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:22.797383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:22.797765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:22.798066 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:22.965730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71c0d-9880-4216-a373-269447a80753 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:22.985361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:22.985905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:22.989098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:22.989839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:22.990527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:22.996911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:23.037989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:23.042750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:23.065046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 708/1427] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:22 2022] POST /identity/v3/projects => generated 381 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:23.071806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:23.074172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 720/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:23.208205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f554c8-0c25-449f-bf66-e230e9bed2ee admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:23.216648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:23.217548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:23.217933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:23.218431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:23.219573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:23.222544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:23.312830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 709/1429] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:23 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:23.316415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:23.339532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df270e-b0d5-4878-beef-529dc3b23baf service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:23.356770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:23.358132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:23.359590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:23.360050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:23.360890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:23.363253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:23.417624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 721/1430] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:24:23.423005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:23.484046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2f051-25fc-4ed6-8d40-de3dc050eeca admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:23.508405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:23.512521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:23.512976 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:23.514242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] PATH_INFO: `/v3/projects/2a33428fddc54bf1ac84e1ed2cd3c3f9/users/83e1db1584f74f15ad92711149545698/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:23.601297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a33428fddc54bf1ac84e1ed2cd3c3f9, user_id=83e1db1584f74f15ad92711149545698, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:23.614043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:23.644407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 710/1431] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:23 2022] PUT /identity/v3/projects/2a33428fddc54bf1ac84e1ed2cd3c3f9/users/83e1db1584f74f15ad92711149545698/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:23.648439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:23.662692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b27e-63a8-45cd-82e2-b1f41042ed0c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:23.724518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:24.118657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400c82a-b335-4252-a9cd-239995f04e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:24.121239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400c82a-b335-4252-a9cd-239995f04e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:24.121886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400c82a-b335-4252-a9cd-239995f04e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:24.122282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400c82a-b335-4252-a9cd-239995f04e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:24.123335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400c82a-b335-4252-a9cd-239995f04e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:24.125370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400c82a-b335-4252-a9cd-239995f04e2f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:24.143161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 722/1432] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:24.143295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:24.159918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111dc76-a6a8-4681-b81e-ad1c50fdbdb5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:24.199228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:24.200767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:24.200767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:24.200767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] PATH_INFO: `/v3/projects/2a33428fddc54bf1ac84e1ed2cd3c3f9/users/83e1db1584f74f15ad92711149545698/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:24.209414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a33428fddc54bf1ac84e1ed2cd3c3f9, user_id=83e1db1584f74f15ad92711149545698, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:24.212430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:24.281833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 711/1433] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:24 2022] PUT /identity/v3/projects/2a33428fddc54bf1ac84e1ed2cd3c3f9/users/83e1db1584f74f15ad92711149545698/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:24.299601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0279b57-5990-463a-ace6-42bfe92bf82f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:24.299955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0279b57-5990-463a-ace6-42bfe92bf82f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:24.300237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0279b57-5990-463a-ace6-42bfe92bf82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:24.388706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d0279b57-5990-463a-ace6-42bfe92bf82f None None] MFA Rules not processed for user `83e1db1584f74f15ad92711149545698`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:24.389956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d0279b57-5990-463a-ace6-42bfe92bf82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:24.587785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 723/1434] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:24.722630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:24.727245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:24.873699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94553-6111-4282-9a1d-b519fe5df759 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:24.886235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30d620-fdec-4a8a-8167-be1e6dd951ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:24.887105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d620-fdec-4a8a-8167-be1e6dd951ed service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:24.887527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d620-fdec-4a8a-8167-be1e6dd951ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:24.888344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d620-fdec-4a8a-8167-be1e6dd951ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:24.907037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30d620-fdec-4a8a-8167-be1e6dd951ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:24.908979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30d620-fdec-4a8a-8167-be1e6dd951ed service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:24.922587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 712/1435] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:25.327342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0279b57-5990-463a-ace6-42bfe92bf82f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:25.357310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0279b57-5990-463a-ace6-42bfe92bf82f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:25.371893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:25.372685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:25.375432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:25.377098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:25.550312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:25.552530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:25.600246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 724/1436] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:26.273239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:26.273738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:26.274030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:26.307826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:26.478648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:26.495213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:26.731196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 713/1437] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:27.281523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:27.283576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:27.452128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:27.579763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165f776-32ca-4da7-a561-7599a73474b6 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:27.598684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0daa-a78a-47a1-88ed-293317ff7cf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:27.599360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0daa-a78a-47a1-88ed-293317ff7cf8 service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:27.600108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0daa-a78a-47a1-88ed-293317ff7cf8 service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:27.600411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0daa-a78a-47a1-88ed-293317ff7cf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:27.624156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b0daa-a78a-47a1-88ed-293317ff7cf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:27.626243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b0daa-a78a-47a1-88ed-293317ff7cf8 service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:27.649658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 725/1438] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:24:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:24:29.507206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:29.509514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:29.749993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f5147-6778-4e53-9ba6-a976b30f4d33 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:29.774251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:29.775667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:29.779038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:29.788186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] PATH_INFO: `/v3/users/b5866b2ba9a840bdb011594850265dc8` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:29.795918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5866b2ba9a840bdb011594850265dc8)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:29.799202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:29.994431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5866b2ba9a840bdb011594850265dc8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:29.999125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5866b2ba9a840bdb011594850265dc8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.041738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5866b2ba9a840bdb011594850265dc8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.087606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5866b2ba9a840bdb011594850265dc8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.158143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:30.165549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5866b2ba9a840bdb011594850265dc8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.200042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 714/1439] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:29 2022] DELETE /identity/v3/users/b5866b2ba9a840bdb011594850265dc8 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:30.203742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:30.204280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:30.204280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:30.241470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:30.243802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:30.244238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:30.246217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:30.413472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 726/1440] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:30.489645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3b9a0-a44f-43a4-9ca8-caf7749f4911 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:30.492581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:30.494162 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:30.517289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:30.518012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:30.518298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:30.518697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] PATH_INFO: `/v3/users/5755364561b14989adc673c07938341c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:30.521010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5755364561b14989adc673c07938341c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:30.523494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:30.668921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd52073-fb2c-470c-8a65-546e8b7a9be3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:30.680705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b19de6-2621-4fd6-b44d-31661cdf488a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:30.681491 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19de6-2621-4fd6-b44d-31661cdf488a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:30.681783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19de6-2621-4fd6-b44d-31661cdf488a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:30.682768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19de6-2621-4fd6-b44d-31661cdf488a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:30.683050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5755364561b14989adc673c07938341c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.684665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5755364561b14989adc673c07938341c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.712979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b19de6-2621-4fd6-b44d-31661cdf488a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:30.714692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b19de6-2621-4fd6-b44d-31661cdf488a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:30.714974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5755364561b14989adc673c07938341c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.730126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5755364561b14989adc673c07938341c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.745576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 727/1441] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:30.746726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199e3cd-853b-43f2-aab4-7649d871e595 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:30.747179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199e3cd-853b-43f2-aab4-7649d871e595 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:30.747311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199e3cd-853b-43f2-aab4-7649d871e595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:30.774465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a199e3cd-853b-43f2-aab4-7649d871e595 None None] MFA Rules not processed for user `9b0ffc12a2fe49938b8a5ab56cd9721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:30.776910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a199e3cd-853b-43f2-aab4-7649d871e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:30.777702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5755364561b14989adc673c07938341c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:30.795730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 728/1442] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 19 13:24:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:30.807006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 715/1443] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:30 2022] DELETE /identity/v3/users/5755364561b14989adc673c07938341c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:30.812468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:30.812883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:30.813247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:30.852147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:30.855799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:31.000678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:31.064359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 729/1444] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:31.240478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:31.242100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:31.282505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:31.284720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:31.517063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6168cc3-5e5d-4ce0-9f33-b7c17ffab622 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:31.521623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b7ed0-f5c3-4744-a0ef-02fa6deed6ee None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:31.531107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d5060-698a-47a9-a681-c322fa83a7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:31.532547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d5060-698a-47a9-a681-c322fa83a7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:31.532993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d5060-698a-47a9-a681-c322fa83a7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:31.534397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d5060-698a-47a9-a681-c322fa83a7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:31.550560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45459c82-7ef6-46ee-a2f2-08a56d69db2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:31.551243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45459c82-7ef6-46ee-a2f2-08a56d69db2b service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:31.556299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45459c82-7ef6-46ee-a2f2-08a56d69db2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:31.556641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45459c82-7ef6-46ee-a2f2-08a56d69db2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:31.559998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d5060-698a-47a9-a681-c322fa83a7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:31.564295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d5060-698a-47a9-a681-c322fa83a7e5 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:31.594392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 730/1445] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:31.623971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45459c82-7ef6-46ee-a2f2-08a56d69db2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:31.632816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45459c82-7ef6-46ee-a2f2-08a56d69db2b service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:31.699661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 716/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:31.757195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:31.757440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:31.758146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:31.809065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] MFA Rules not processed for user `8f85c5d88c324fd790b6282e714861de`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:31.813200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:31.992320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 731/1447] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:32.327792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c413c-d430-425a-b7fd-4424c92e3a7c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:32.328170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c413c-d430-425a-b7fd-4424c92e3a7c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:32.328445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c413c-d430-425a-b7fd-4424c92e3a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:32.426534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2d6c413c-d430-425a-b7fd-4424c92e3a7c None None] MFA Rules not processed for user `30c408bc33b84cadb1b16ac2327011d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:32.441309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2d6c413c-d430-425a-b7fd-4424c92e3a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:32.502844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:32.735174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 717/1448] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:33.462853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:33.465624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:33.497884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f11d19-3cbd-48c8-a255-c9a8486f85c0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:33.511070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:33.512093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:33.512606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:33.513447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] PATH_INFO: `/v3/projects/5c6b483084724ac7b2557007b723b99a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:33.517208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6b483084724ac7b2557007b723b99a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:33.519696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:33.650542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6b483084724ac7b2557007b723b99a', 'request_id': 'req-8a5f2113-aaf1-401a-bc3b-89192f29f830'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:33.669580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6b483084724ac7b2557007b723b99a', 'request_id': 'req-8a5f2113-aaf1-401a-bc3b-89192f29f830'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:33.684697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6b483084724ac7b2557007b723b99a', 'request_id': 'req-8a5f2113-aaf1-401a-bc3b-89192f29f830'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:33.710774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] The token cache is being invalidate because project 5c6b483084724ac7b2557007b723b99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:33.711782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:33.712505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:33.715064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 732/1449] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:33 2022] DELETE /identity/v3/projects/5c6b483084724ac7b2557007b723b99a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:33.719322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c413c-d430-425a-b7fd-4424c92e3a7c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:33.738743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c413c-d430-425a-b7fd-4424c92e3a7c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:33.891398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:33.892909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:33.893567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:33.894041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] PATH_INFO: `/v3/users/e2338167ade349008a5137189b1c080f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:33.898346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2338167ade349008a5137189b1c080f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:33.903498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:34.011751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2338167ade349008a5137189b1c080f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.014537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2338167ade349008a5137189b1c080f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.025249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2338167ade349008a5137189b1c080f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.039457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2338167ade349008a5137189b1c080f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.076706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2338167ade349008a5137189b1c080f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.094709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 718/1450] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:33 2022] DELETE /identity/v3/users/e2338167ade349008a5137189b1c080f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:34.130591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:34.133644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:34.163042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f2113-aaf1-401a-bc3b-89192f29f830 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:34.202741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:34.325214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:34.331205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:34.331581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:34.332064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] PATH_INFO: `/v3/users/006aa835fc4e46b78befb80aef9669d5` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:34.333598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] RBAC: Authorizing `identity:delete_user(user_id=006aa835fc4e46b78befb80aef9669d5)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:34.335721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:34.464562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006aa835fc4e46b78befb80aef9669d5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.466759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006aa835fc4e46b78befb80aef9669d5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.491232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:34.493007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:34.496165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006aa835fc4e46b78befb80aef9669d5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.524223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006aa835fc4e46b78befb80aef9669d5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.524687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43685b1-c529-4328-aac0-20017388adab admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:34.526707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5c54d62-0836-46cf-805b-7496fcbd273b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006aa835fc4e46b78befb80aef9669d5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.551182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:34.552922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:34.553355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:34.554553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] PATH_INFO: `/v3/users/fe09b929f2654007a87ca55f4fd4d1b3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:34.564892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe09b929f2654007a87ca55f4fd4d1b3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:34.567216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:34.574187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 733/1451] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:34 2022] DELETE /identity/v3/users/006aa835fc4e46b78befb80aef9669d5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:34.582860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929d284-98d8-4859-b063-31c2757b51d0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:34.583617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929d284-98d8-4859-b063-31c2757b51d0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:34.584239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929d284-98d8-4859-b063-31c2757b51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:34.656610 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4929d284-98d8-4859-b063-31c2757b51d0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:34.658479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4929d284-98d8-4859-b063-31c2757b51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:34.712716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:34.760745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe09b929f2654007a87ca55f4fd4d1b3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.762364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe09b929f2654007a87ca55f4fd4d1b3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.784632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe09b929f2654007a87ca55f4fd4d1b3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.805104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe09b929f2654007a87ca55f4fd4d1b3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.886736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-560a57d3-c259-488e-8a43-b00944809145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe09b929f2654007a87ca55f4fd4d1b3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:34.923284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 719/1452] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:34 2022] DELETE /identity/v3/users/fe09b929f2654007a87ca55f4fd4d1b3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:34.924092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfa65e-abf8-4a57-af9b-ab74d3f16125 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:34.924419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfa65e-abf8-4a57-af9b-ab74d3f16125 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:34.924664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfa65e-abf8-4a57-af9b-ab74d3f16125 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:34.936194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 720/1453] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:24:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:34.940949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 734/1454] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:34.943772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:34.944102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:34.944491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:34.976092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0093-9625-4225-9f02-1d6c6504ba6b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:34.977069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0093-9625-4225-9f02-1d6c6504ba6b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:34.977715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d0093-9625-4225-9f02-1d6c6504ba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:34.994190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:34.995508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:35.078217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-487d0093-9625-4225-9f02-1d6c6504ba6b None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:35.085933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-487d0093-9625-4225-9f02-1d6c6504ba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:35.163832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 721/1455] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:35.167155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:35.167155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:35.220741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:35.319093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107201-cf90-431e-97b8-d3a2f6113120 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:35.319559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 735/1456] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:24:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:35.320831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d0093-9625-4225-9f02-1d6c6504ba6b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:35.332859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:35.333640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:35.334274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:35.334274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:35.347104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d0093-9625-4225-9f02-1d6c6504ba6b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:35.355239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:35.355845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:35.356129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:35.356411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:35.358744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:35.361722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:35.375119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 722/1457] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:35.393311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:35.404018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:35.436035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 736/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:36.327960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:36.329695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:36.355169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eb59f-225d-4b24-8a19-dce6d7bdfe99 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:36.367043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:36.367740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:36.369183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:36.369492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] PATH_INFO: `/v3/projects/09d2b7d0debf452f9bfa8a88c5aaf54c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:36.371803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d2b7d0debf452f9bfa8a88c5aaf54c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:36.379221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:36.506092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d2b7d0debf452f9bfa8a88c5aaf54c', 'request_id': 'req-2646cf53-2564-4316-8abc-a8536e12bff8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.509719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:36.524424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d2b7d0debf452f9bfa8a88c5aaf54c', 'request_id': 'req-2646cf53-2564-4316-8abc-a8536e12bff8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.573507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d2b7d0debf452f9bfa8a88c5aaf54c', 'request_id': 'req-2646cf53-2564-4316-8abc-a8536e12bff8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.600855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] The token cache is being invalidate because project 09d2b7d0debf452f9bfa8a88c5aaf54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:36.601167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.605770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2646cf53-2564-4316-8abc-a8536e12bff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.620457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 723/1459] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:36 2022] DELETE /identity/v3/projects/09d2b7d0debf452f9bfa8a88c5aaf54c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:36.624331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:36.638155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b317-9514-4669-b30a-d5d74009780f service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:36.817130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:36.817850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:36.818203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:36.818613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] PATH_INFO: `/v3/users/d1883327df87414eb5d953723847249b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:36.820319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1883327df87414eb5d953723847249b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:36.822893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:36.910353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1883327df87414eb5d953723847249b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.911351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1883327df87414eb5d953723847249b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.922790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1883327df87414eb5d953723847249b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.941511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1883327df87414eb5d953723847249b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.943177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1883327df87414eb5d953723847249b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:36.986674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 737/1460] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:36 2022] DELETE /identity/v3/users/d1883327df87414eb5d953723847249b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:37.472044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1f45-fa1e-48e9-b2a0-70742f2c87f8 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:37.473035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1f45-fa1e-48e9-b2a0-70742f2c87f8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:37.473628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1f45-fa1e-48e9-b2a0-70742f2c87f8 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:37.475977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 724/1461] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:24:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:37.639976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:37.643006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:37.644098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:37.644657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:37.645145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:37.726252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:37.728086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:37.737267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:37.814669 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b515e-9a51-4a50-8af3-a1c1cc202b6f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:37.830980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:37.838464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:37.838756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:37.839040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] PATH_INFO: `/v3/projects/cb9fb2d3b4774e7fa6d9757d0fe2c0ba` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:37.843939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb9fb2d3b4774e7fa6d9757d0fe2c0ba)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:37.845913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:37.953879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 725/1462] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:37.973378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:37.975837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:38.007568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc25e0-a28d-40a2-a2e3-327d1a4fd119 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:38.043239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9fb2d3b4774e7fa6d9757d0fe2c0ba', 'request_id': 'req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.066015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9fb2d3b4774e7fa6d9757d0fe2c0ba', 'request_id': 'req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.085743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9fb2d3b4774e7fa6d9757d0fe2c0ba', 'request_id': 'req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.137389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] The token cache is being invalidate because project cb9fb2d3b4774e7fa6d9757d0fe2c0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:38.138197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.139420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.143493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 738/1463] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:37 2022] DELETE /identity/v3/projects/cb9fb2d3b4774e7fa6d9757d0fe2c0ba => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:38.144529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:38.155288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:38.270463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:38.271343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:38.271616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:38.271895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] PATH_INFO: `/v3/projects/8d795e9877894f668476e5d6f2b5ec5d` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:38.276407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d795e9877894f668476e5d6f2b5ec5d)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:38.279119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:38.340042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f0cf-eb9e-42ed-97ce-017ded1d0f76 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:38.364814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:38.365463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:38.365741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:38.367673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:38.372531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:38.405411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:38.407283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:38.429336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d795e9877894f668476e5d6f2b5ec5d', 'request_id': 'req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.436579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 739/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:38.437738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:38.444349 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:38.462066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d795e9877894f668476e5d6f2b5ec5d', 'request_id': 'req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.480434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d795e9877894f668476e5d6f2b5ec5d', 'request_id': 'req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.484697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53c8b3-dd79-438f-bf8f-010b5406598c service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:38.499512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:38.515053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] The token cache is being invalidate because project 8d795e9877894f668476e5d6f2b5ec5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:38.515713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.517023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-dff76a8e-2ebf-456e-a5c0-0f619476ee1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.526447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 726/1465] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:37 2022] DELETE /identity/v3/projects/8d795e9877894f668476e5d6f2b5ec5d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:38.536726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b791-8319-4603-88eb-5ecee7e86829 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:38.537019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b791-8319-4603-88eb-5ecee7e86829 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:38.537295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b791-8319-4603-88eb-5ecee7e86829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:38.603568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f1c3b791-8319-4603-88eb-5ecee7e86829 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:38.607689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f1c3b791-8319-4603-88eb-5ecee7e86829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:38.644458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:38.724180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:38.724844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:38.725127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:38.725398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] PATH_INFO: `/v3/projects/6b29275524df47f692eca76251047d99` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:38.733529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b29275524df47f692eca76251047d99)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:38.743833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:38.809330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 727/1466] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:38.813975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806818-a017-4d75-903c-3b483f5baca6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:38.814269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806818-a017-4d75-903c-3b483f5baca6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:38.814545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806818-a017-4d75-903c-3b483f5baca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:38.850516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2c806818-a017-4d75-903c-3b483f5baca6 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:38.851975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2c806818-a017-4d75-903c-3b483f5baca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:38.866902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 728/1467] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:38.871177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:38.871838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:38.872351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:38.905372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b29275524df47f692eca76251047d99', 'request_id': 'req-33b1c84d-5dfd-49e6-9237-c30177d1e190'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.924362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b29275524df47f692eca76251047d99', 'request_id': 'req-33b1c84d-5dfd-49e6-9237-c30177d1e190'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.928881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:38.930528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:38.940049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b29275524df47f692eca76251047d99', 'request_id': 'req-33b1c84d-5dfd-49e6-9237-c30177d1e190'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.964395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] The token cache is being invalidate because project 6b29275524df47f692eca76251047d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:38.964687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.966685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-33b1c84d-5dfd-49e6-9237-c30177d1e190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:38.968433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 740/1468] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:38 2022] DELETE /identity/v3/projects/6b29275524df47f692eca76251047d99 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:38.969658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a544e-ecaf-4ffe-9f17-d6767982285d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:38.969965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a544e-ecaf-4ffe-9f17-d6767982285d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:38.977258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a544e-ecaf-4ffe-9f17-d6767982285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.012659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7d8a544e-ecaf-4ffe-9f17-d6767982285d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:39.013940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7d8a544e-ecaf-4ffe-9f17-d6767982285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.035412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 729/1469] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:39.036296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.037921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.096762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 741/1470] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:39.098525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78a28-38fc-471b-b4d1-81b5bf2ebb84 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.098829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78a28-38fc-471b-b4d1-81b5bf2ebb84 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.099152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78a28-38fc-471b-b4d1-81b5bf2ebb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.121653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d9d78a28-38fc-471b-b4d1-81b5bf2ebb84 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:39.123485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d9d78a28-38fc-471b-b4d1-81b5bf2ebb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.142057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 742/1471] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:39.143229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78a28-38fc-471b-b4d1-81b5bf2ebb84 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.175885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78a28-38fc-471b-b4d1-81b5bf2ebb84 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.193178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.194576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.195321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.196173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.197994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:39.198750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.202057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.223237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 743/1472] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:39.224412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.255814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9e774-11dd-4b31-8522-4c6da3e18b83 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.256823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812300bd-92ab-4988-bdef-997ffd309ea9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.263402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ea110-a4bd-405f-b8fc-7698ce284045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.263926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.264045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ea110-a4bd-405f-b8fc-7698ce284045 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.264559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.264661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ea110-a4bd-405f-b8fc-7698ce284045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.264845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ea110-a4bd-405f-b8fc-7698ce284045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.264947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.265607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.265719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ea110-a4bd-405f-b8fc-7698ce284045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:39.265791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ea110-a4bd-405f-b8fc-7698ce284045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.267559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ea110-a4bd-405f-b8fc-7698ce284045 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.269543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.287007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.288535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.295274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 744/1473] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:39.296683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f5485-f252-43f3-ba40-0b61f1b9765c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.297562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f5485-f252-43f3-ba40-0b61f1b9765c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.297848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f5485-f252-43f3-ba40-0b61f1b9765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.319558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 730/1474] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:39.324475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.327418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.345402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-685f5485-f252-43f3-ba40-0b61f1b9765c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:39.346834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-685f5485-f252-43f3-ba40-0b61f1b9765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.362443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310b77-6b16-4be4-829a-466ab2e0ff5d service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.377742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 745/1475] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:39.380902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.382022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f5485-f252-43f3-ba40-0b61f1b9765c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.384070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.386579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.386885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] PATH_INFO: `/v3/projects/0b086564ac37461eb775008090aa1381` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.390097 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b086564ac37461eb775008090aa1381)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.398668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.413287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f5485-f252-43f3-ba40-0b61f1b9765c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.433617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.434327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.434615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.434889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.435573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.444555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.447130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:39.506958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 746/1476] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:39 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:39.508271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.546822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:39.560970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b086564ac37461eb775008090aa1381', 'request_id': 'req-37e169bc-3398-41cc-82ce-e6d07bc9dcff'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:39.583524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b086564ac37461eb775008090aa1381', 'request_id': 'req-37e169bc-3398-41cc-82ce-e6d07bc9dcff'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:39.603133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b086564ac37461eb775008090aa1381', 'request_id': 'req-37e169bc-3398-41cc-82ce-e6d07bc9dcff'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:39.640410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] The token cache is being invalidate because project 0b086564ac37461eb775008090aa1381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:39.642059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:39.643509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:39.648958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 731/1477] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:39 2022] DELETE /identity/v3/projects/0b086564ac37461eb775008090aa1381 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:39.651892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.655936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.669783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c68ca9-1a34-4bd5-bc2c-9d82a7094354 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.780152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.780805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.781090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.781368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.782253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.784213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.834130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 747/1478] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:39 2022] POST /identity/v3/projects => generated 365 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:39.835190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.839589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e169bc-3398-41cc-82ce-e6d07bc9dcff admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.839993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.919933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.920915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.921220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.921537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.922317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:39.922631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.924906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.944044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 732/1479] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:39.944937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:39.947814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:39.968623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10042-d22f-42e4-ab11-af76723bd1eb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.976495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:39.977505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:39.977883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:39.978570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] PATH_INFO: `/v3/users/83e1db1584f74f15ad92711149545698` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:39.979479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d1844-15fe-4043-b504-853dffd16cf4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:39.981041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e1db1584f74f15ad92711149545698)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:39.986269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:39.999612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.001754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.004273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.004944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.007539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.011912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.089055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 748/1480] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:39 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:40.090836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.092926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:40.111530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:40.132622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210435-213f-4d27-97ac-9151040ec642 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.144586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e1db1584f74f15ad92711149545698'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:40.145841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e1db1584f74f15ad92711149545698'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:40.152906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173e944-a691-410f-9064-305e3521854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.153695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e944-a691-410f-9064-305e3521854c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.154047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e944-a691-410f-9064-305e3521854c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.154584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e944-a691-410f-9064-305e3521854c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.155735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173e944-a691-410f-9064-305e3521854c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.158023 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173e944-a691-410f-9064-305e3521854c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.167156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e1db1584f74f15ad92711149545698'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:40.187745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 749/1481] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:40 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:40.189450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173e944-a691-410f-9064-305e3521854c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.192383 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e1db1584f74f15ad92711149545698'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:40.209622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e1db1584f74f15ad92711149545698'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:40.212389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173e944-a691-410f-9064-305e3521854c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.217479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.218211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.218824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.218932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.219884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.221854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.225537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 733/1482] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:39 2022] DELETE /identity/v3/users/83e1db1584f74f15ad92711149545698 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:40.228471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.229958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:40.266370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:40.283501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 750/1483] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:40 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:40.287506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.291658 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:40.408711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a88e0-a198-4819-878b-150fc35e008d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.410891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8420d8-4888-46f9-b5bf-fa38dabb8826 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.416989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.417776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.418096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.418440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.419215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.420361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.420996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.421335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.421558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.421653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.424540 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.426340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.435996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 751/1484] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:40.437563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.440150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:40.454120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 734/1485] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:40.458415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa88822-178e-4200-8d56-770703f19486 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.460644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.464697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.465677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.466155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.466622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.467499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.469891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.484553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bd3ce-4765-4228-999d-fc237c81acd0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.497074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.497717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.498024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.498335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.498923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.500592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.504286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 752/1486] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:40 2022] POST /identity/v3/users => generated 291 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:40.505602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.519476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8323af-8bde-4688-b2bf-b95194279837 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.521801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 735/1487] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:40.522931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.528104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.531108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.531895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.532668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.534236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.540570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.555816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbae8b-cfb1-4f0e-8ea7-8fd13e19891b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.558473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 753/1488] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:40.559734 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.566037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.566713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.566953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.572456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.573229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.575015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.598151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d481-8b89-4b42-9b2e-34486657bf54 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.609891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 736/1489] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:40.611103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.611758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.612975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.613094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.613391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] PATH_INFO: `/v3/projects/a186b0a01e7e4b94a72f769ab848f939/users/64a53638f81d4dbdb859507ab743123c/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.632669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492fc1-77f2-472c-8eee-fc72a4d880da admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.643572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a186b0a01e7e4b94a72f769ab848f939, user_id=64a53638f81d4dbdb859507ab743123c, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.644462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00665-859d-482e-91d9-2e4ae3492bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.645403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00665-859d-482e-91d9-2e4ae3492bac admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.645895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00665-859d-482e-91d9-2e4ae3492bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.646245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.646477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00665-859d-482e-91d9-2e4ae3492bac admin admin] PATH_INFO: `/v3/projects/3dbdc31ff4db46e5b4b7f752b61a0de2/users/83bff425755f49a887b8b2badeaa80c1/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.676606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 754/1490] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:40 2022] PUT /identity/v3/projects/a186b0a01e7e4b94a72f769ab848f939/users/64a53638f81d4dbdb859507ab743123c/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:40.676606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.695324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc00665-859d-482e-91d9-2e4ae3492bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbdc31ff4db46e5b4b7f752b61a0de2, user_id=83bff425755f49a887b8b2badeaa80c1, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.706007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc00665-859d-482e-91d9-2e4ae3492bac admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.736189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 737/1491] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:40 2022] PUT /identity/v3/projects/3dbdc31ff4db46e5b4b7f752b61a0de2/users/83bff425755f49a887b8b2badeaa80c1/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:40.740786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcc3a8-fdd1-4c3b-a186-7387331a3b84 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.741150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcc3a8-fdd1-4c3b-a186-7387331a3b84 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.741500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcc3a8-fdd1-4c3b-a186-7387331a3b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.776863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-addcc3a8-fdd1-4c3b-a186-7387331a3b84 None None] MFA Rules not processed for user `64a53638f81d4dbdb859507ab743123c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:40.780988 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-addcc3a8-fdd1-4c3b-a186-7387331a3b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:40.788918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2205f-0b42-4b3b-afaa-bdb0fb51891c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.851453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:40.866994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.869444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.870044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.870835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:40.871604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.872454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.875173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.886054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 738/1492] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:40.887582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.888206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.888645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.899906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 755/1493] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:40.899906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:40.915860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1788060-3fce-4093-a271-78bc7e8eca91 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:40.921787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:40.923382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:40.927472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:40.927756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:40.928884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:40.931178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:40.931569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] MFA Rules not processed for user `83bff425755f49a887b8b2badeaa80c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:40.933149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:40.968860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 756/1494] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:40 2022] POST /identity/v3/projects => generated 361 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:40.970178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.015056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 739/1495] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:41.015936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.017200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:41.031019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140f88-fc1b-4efb-9822-d3df88a7d80e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.042731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7d3b3-25f7-43fd-b7cf-e5a5d42b5155 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.047603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.048270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.048563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.048837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] PATH_INFO: `/v3/projects/a80694b68443407d8b97f5054f5ec2c7/users/078f3484e1c74302b9c11c15cc8dd352/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.064623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80694b68443407d8b97f5054f5ec2c7, user_id=078f3484e1c74302b9c11c15cc8dd352, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.067334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.080583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 757/1496] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:40 2022] PUT /identity/v3/projects/a80694b68443407d8b97f5054f5ec2c7/users/078f3484e1c74302b9c11c15cc8dd352/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:41.081156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.096651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.097302 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.097580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.097848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] PATH_INFO: `/v3/projects/2a33428fddc54bf1ac84e1ed2cd3c3f9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.099021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a33428fddc54bf1ac84e1ed2cd3c3f9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.101148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.154541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a33428fddc54bf1ac84e1ed2cd3c3f9', 'request_id': 'req-e26b6703-f661-485b-9348-19eb46a2702c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:41.158327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaa5be-9ca2-4a23-a6ae-f416352891b2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.170367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a33428fddc54bf1ac84e1ed2cd3c3f9', 'request_id': 'req-e26b6703-f661-485b-9348-19eb46a2702c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:41.174861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a33428fddc54bf1ac84e1ed2cd3c3f9', 'request_id': 'req-e26b6703-f661-485b-9348-19eb46a2702c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:41.196202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] The token cache is being invalidate because project 2a33428fddc54bf1ac84e1ed2cd3c3f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:41.196501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:41.198490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:41.202141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 740/1497] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:41 2022] DELETE /identity/v3/projects/2a33428fddc54bf1ac84e1ed2cd3c3f9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:41.203802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.206417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:41.236542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:41.241470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:41.252045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae5ee1-6d50-493c-8c86-906cfdbc23e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.252694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5ee1-6d50-493c-8c86-906cfdbc23e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.252888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5ee1-6d50-493c-8c86-906cfdbc23e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.253628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5ee1-6d50-493c-8c86-906cfdbc23e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.257777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5ee1-6d50-493c-8c86-906cfdbc23e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.262266 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5ee1-6d50-493c-8c86-906cfdbc23e7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.318153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 758/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:41.319927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.320224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.321836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.353017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b6703-f661-485b-9348-19eb46a2702c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.364660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943a6d-d9c7-492d-8733-d8769695e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.365515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943a6d-d9c7-492d-8733-d8769695e605 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.366087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943a6d-d9c7-492d-8733-d8769695e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.366533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943a6d-d9c7-492d-8733-d8769695e605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.367496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943a6d-d9c7-492d-8733-d8769695e605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.371375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943a6d-d9c7-492d-8733-d8769695e605 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.371513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] MFA Rules not processed for user `078f3484e1c74302b9c11c15cc8dd352`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:41.372719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:41.420470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 741/1499] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:41.423205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd68f-20ef-415b-8dfd-35f7a40f2a05 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.423499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd68f-20ef-415b-8dfd-35f7a40f2a05 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.424241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd68f-20ef-415b-8dfd-35f7a40f2a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.444986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6bacd68f-20ef-415b-8dfd-35f7a40f2a05 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:41.446527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6bacd68f-20ef-415b-8dfd-35f7a40f2a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:41.464128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 759/1500] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:41.464993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.466289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:41.480030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c39d7-621a-4113-a813-e8dda04764ae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.521606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 742/1501] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:41.522510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacd68f-20ef-415b-8dfd-35f7a40f2a05 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.532795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacd68f-20ef-415b-8dfd-35f7a40f2a05 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.537423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a867c-2c46-460c-9586-1b9c10222cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.538014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a867c-2c46-460c-9586-1b9c10222cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.538292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a867c-2c46-460c-9586-1b9c10222cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.538566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a867c-2c46-460c-9586-1b9c10222cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.539229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a867c-2c46-460c-9586-1b9c10222cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.541187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a867c-2c46-460c-9586-1b9c10222cd2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.542495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.543165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.543448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.543725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.544494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.546088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.556116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 760/1502] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:41.557918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.560484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:41.566193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 743/1503] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:41.566193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076b3e-f054-456c-a61e-cc9a39179a24 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.566193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076b3e-f054-456c-a61e-cc9a39179a24 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.566193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076b3e-f054-456c-a61e-cc9a39179a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.577457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecd36a-517d-4ea0-9749-db745a45b176 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.583206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.583973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.584157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.585092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.585751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.587835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.591769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-10076b3e-f054-456c-a61e-cc9a39179a24 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:41.593041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-10076b3e-f054-456c-a61e-cc9a39179a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:41.607228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 744/1504] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:41.608247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076b3e-f054-456c-a61e-cc9a39179a24 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.619843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076b3e-f054-456c-a61e-cc9a39179a24 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.625559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.626223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.626609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.626977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] PATH_INFO: `/v3/projects/ecccffb7307d428b8753ef3174115357/users/df4abcd9779c4106bebfeed608006387/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.629003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 761/1505] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:41.629852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.652497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecccffb7307d428b8753ef3174115357, user_id=df4abcd9779c4106bebfeed608006387, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.655492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.670867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 745/1506] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:41 2022] PUT /identity/v3/projects/ecccffb7307d428b8753ef3174115357/users/df4abcd9779c4106bebfeed608006387/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:41.671719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.692332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:41.707648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a5b45-f985-4350-b638-9318ef4ff750 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.726835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:41.739486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d33a3-95ca-4c65-82b9-7925f1677608 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.744289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.744901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.745182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.745459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.746099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:41.746401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.748043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.760622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 746/1507] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:41.761369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.768049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.768653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.768945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.769221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.769871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.770948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cdd11-f789-4f25-bf13-08e77bb24ac8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.771508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.776150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.776729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.777016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.777296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.777923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.779854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.782045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 762/1508] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:41.782850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.792875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301478a-bce3-4968-ab79-31fd0240a63e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.798785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.799539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.799823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.800099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.800744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.802587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.806239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 747/1509] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:41.807569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.815852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 763/1510] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:41.815852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.820022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b2296-fde6-482a-9282-a3148dbd4385 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.823121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf4479-234a-40d9-a48b-8cbee108d248 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.824796 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.825390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.825670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.825940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.826659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.827865 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.828492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.828598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.828777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.829056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] PATH_INFO: `/v3/projects/33e6afb09c594c039550a34253e34bd0/users/da2e9e62389d4009a68b61da0aa973eb/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.844275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e6afb09c594c039550a34253e34bd0, user_id=da2e9e62389d4009a68b61da0aa973eb, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.847343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.857600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 748/1511] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:41.860033 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.861081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 764/1512] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:41 2022] PUT /identity/v3/projects/33e6afb09c594c039550a34253e34bd0/users/da2e9e62389d4009a68b61da0aa973eb/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:41.861860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.923563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e099f42-a5ea-4af7-b84b-9b03e9baed9f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.926563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15234-f02d-4b0a-8d74-ade6310f9ba9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:41.928179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.928784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.929058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.929334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.929973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.931344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:41.931646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.932032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:41.932603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:41.932882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] PATH_INFO: `/v3/projects/ecccffb7307d428b8753ef3174115357/users/df4abcd9779c4106bebfeed608006387/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:41.934815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecccffb7307d428b8753ef3174115357, user_id=df4abcd9779c4106bebfeed608006387, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:41.937528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:41.943693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 749/1513] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:41.944656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.951028 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 765/1514] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:41 2022] PUT /identity/v3/projects/ecccffb7307d428b8753ef3174115357/users/df4abcd9779c4106bebfeed608006387/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:41.952805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:41.955348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb6d29-5f07-4e53-91a2-e318a93d51fd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.008332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:42.017724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22fc56-7fca-49ad-adbc-6184eec2b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.019117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22fc56-7fca-49ad-adbc-6184eec2b0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.019117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22fc56-7fca-49ad-adbc-6184eec2b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.019117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22fc56-7fca-49ad-adbc-6184eec2b0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.019558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22fc56-7fca-49ad-adbc-6184eec2b0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.021503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22fc56-7fca-49ad-adbc-6184eec2b0d8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.024187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e791e1-0706-4f7e-9305-c9c9e1446482 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.029504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.030153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.030443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.030720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.031396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.033099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.043619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 766/1515] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:42.046478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 750/1516] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:41 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:42.049895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.050040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5ca8-5d4b-4259-8388-75826673791a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.050040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5ca8-5d4b-4259-8388-75826673791a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.050040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5ca8-5d4b-4259-8388-75826673791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.064000 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1893b-4071-4a53-94fc-b427e951cbcc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.068891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.069757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.070967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.071309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] PATH_INFO: `/v3/projects/2269dc8bcdc94363bb8381dbe706e538/users/25a269d98d8940e2bc6000c6bd13752f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.078611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-063d5ca8-5d4b-4259-8388-75826673791a None None] MFA Rules not processed for user `df4abcd9779c4106bebfeed608006387`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:42.079987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-063d5ca8-5d4b-4259-8388-75826673791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:42.088598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2269dc8bcdc94363bb8381dbe706e538, user_id=25a269d98d8940e2bc6000c6bd13752f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.091276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.105272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:42.111035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 767/1517] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:42 2022] PUT /identity/v3/projects/2269dc8bcdc94363bb8381dbe706e538/users/25a269d98d8940e2bc6000c6bd13752f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:42.111035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.159049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 751/1518] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:42.160061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d5ca8-5d4b-4259-8388-75826673791a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.182530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d5ca8-5d4b-4259-8388-75826673791a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.187318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.188642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.188927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.189203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.190026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.191668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fd15c-7478-4d4d-af7f-d2b0c8a41d60 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.191785 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.196383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.197038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.197858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.198131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] PATH_INFO: `/v3/projects/33e6afb09c594c039550a34253e34bd0/users/da2e9e62389d4009a68b61da0aa973eb/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.200081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e6afb09c594c039550a34253e34bd0, user_id=da2e9e62389d4009a68b61da0aa973eb, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.202671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.204215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 752/1519] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:42.205130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.215273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 768/1520] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:42 2022] PUT /identity/v3/projects/33e6afb09c594c039550a34253e34bd0/users/da2e9e62389d4009a68b61da0aa973eb/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:42.225083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.225206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502b344-7cbb-45ae-83ae-75fd0c84d246 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.225304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:42.276032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.276767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.277194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.277483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.278133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.279782 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.282285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca1021-bcce-434b-8adc-c94258fa7341 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.285971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.286583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.286864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.287167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.289636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 753/1521] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:42.290429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.299682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd50539-6805-435c-a067-2acf8d5c46e8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.304327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb922ee-3230-4a8f-a336-ce5dc36cf3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.304909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb922ee-3230-4a8f-a336-ce5dc36cf3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.305186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb922ee-3230-4a8f-a336-ce5dc36cf3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.305894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb922ee-3230-4a8f-a336-ce5dc36cf3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.306181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb922ee-3230-4a8f-a336-ce5dc36cf3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.308433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb922ee-3230-4a8f-a336-ce5dc36cf3a8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.320043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 754/1522] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:42.321392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea034-0067-4b0b-9608-cdd5b2b2a6f2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.321728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea034-0067-4b0b-9608-cdd5b2b2a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.322056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea034-0067-4b0b-9608-cdd5b2b2a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.350753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-04eea034-0067-4b0b-9608-cdd5b2b2a6f2 None None] MFA Rules not processed for user `da2e9e62389d4009a68b61da0aa973eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:42.352086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-04eea034-0067-4b0b-9608-cdd5b2b2a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:42.366854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.368352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.379548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 769/1523] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:42.380478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.399899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b885b-0e93-4405-8f66-de5c66027c81 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.405057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.405814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.405999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.406263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] PATH_INFO: `/v3/projects/2269dc8bcdc94363bb8381dbe706e538/users/25a269d98d8940e2bc6000c6bd13752f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.408237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2269dc8bcdc94363bb8381dbe706e538, user_id=25a269d98d8940e2bc6000c6bd13752f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.410879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.413286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:42.424384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 770/1524] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:42 2022] PUT /identity/v3/projects/2269dc8bcdc94363bb8381dbe706e538/users/25a269d98d8940e2bc6000c6bd13752f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:42.428142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.458776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 755/1525] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:42.462418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.464138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.464526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.532350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907b0e-594f-4cac-88c9-0692cdc29fab admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.537646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] MFA Rules not processed for user `25a269d98d8940e2bc6000c6bd13752f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:42.540775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:42.541613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.542839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.543435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.543866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] PATH_INFO: `/v3/projects/159918898ae64c4da9460d772c29f5b0/users/a712799e982f41cf94f163c8688de6a4/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.549250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:42.601382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159918898ae64c4da9460d772c29f5b0, user_id=a712799e982f41cf94f163c8688de6a4, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.610828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.650934 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 771/1526] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:42 2022] PUT /identity/v3/projects/159918898ae64c4da9460d772c29f5b0/users/a712799e982f41cf94f163c8688de6a4/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:42.652064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.677357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 756/1527] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:42.679337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.681536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:42.750337 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fd183-f8b0-44a2-a2fe-07b63e4ac4d8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.758203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a139498-4a92-418a-99b4-9bd270c8cf00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.759183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a139498-4a92-418a-99b4-9bd270c8cf00 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.759803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a139498-4a92-418a-99b4-9bd270c8cf00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.760331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a139498-4a92-418a-99b4-9bd270c8cf00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.773848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22b438-3b3e-45e2-8ba0-a96f0abcf168 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.778496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.779323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.779857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.780266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.783599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:42.860945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a139498-4a92-418a-99b4-9bd270c8cf00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.862575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a139498-4a92-418a-99b4-9bd270c8cf00 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.877455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 772/1528] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:42.878930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f76d6-821f-4be4-80df-7a15f314b13f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.879381 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f76d6-821f-4be4-80df-7a15f314b13f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.879665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f76d6-821f-4be4-80df-7a15f314b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:42.881716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:42.883718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:42.918602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2d7f76d6-821f-4be4-80df-7a15f314b13f None None] MFA Rules not processed for user `a712799e982f41cf94f163c8688de6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:42.932819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 757/1529] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:42.933164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2d7f76d6-821f-4be4-80df-7a15f314b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:42.941266 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:42.960871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:42.982251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2ffa-5a02-481d-8267-1bd4a1a6d9a8 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:42.987311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:42.988142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:42.988615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:42.989388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.047116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 773/1530] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:43.048035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f76d6-821f-4be4-80df-7a15f314b13f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.096697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:43.114939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.117524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.141943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f76d6-821f-4be4-80df-7a15f314b13f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.150117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 758/1531] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:43.164214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.167866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.168153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.168426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.169096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.171462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.224201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 774/1532] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:43 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:43.228070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.256051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70f9ac-9fb0-4b77-9783-096845203c03 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.316799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.344100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.344855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.345036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.345268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.346048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.348550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.376354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 759/1533] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:43 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:24:43.384026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.395601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac085981-f340-4878-a88f-69237d462023 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.402234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.402995 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.403313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.403583 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.404326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.405940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.414253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bcc4-56cc-40d8-8cb7-7b6aa1816749 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.418879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.419660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.420005 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.420399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.428613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 760/1534] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:43.432949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.457324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15e31-84f6-4b59-8548-cd80461695d5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.464855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.465463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.465740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.466013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] PATH_INFO: `/v3/projects/79f4bf75700f4a128cd76de32ae2f010/users/0eea65a1c3e3467fb8754f407865f3b9/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.488147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f4bf75700f4a128cd76de32ae2f010, user_id=0eea65a1c3e3467fb8754f407865f3b9, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.491069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.494558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:43.497191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.499253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.512642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 775/1535] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:43.514850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 761/1536] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:43 2022] PUT /identity/v3/projects/79f4bf75700f4a128cd76de32ae2f010/users/0eea65a1c3e3467fb8754f407865f3b9/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:43.521677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.534350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c6055-7d67-408f-8fee-ad60631341b0 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.606792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cbd02-dd4f-4392-9bc5-870a715cff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.607463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbd02-dd4f-4392-9bc5-870a715cff81 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.607754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbd02-dd4f-4392-9bc5-870a715cff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.608038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cbd02-dd4f-4392-9bc5-870a715cff81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.608714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cbd02-dd4f-4392-9bc5-870a715cff81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.611415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cbd02-dd4f-4392-9bc5-870a715cff81 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.622068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 776/1537] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:43.626365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.638380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f27b6-3332-43ab-b18d-e5d46b4404e9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.644045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.645286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.645645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.645991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] PATH_INFO: `/v3/projects/79f4bf75700f4a128cd76de32ae2f010/users/0eea65a1c3e3467fb8754f407865f3b9/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.648619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f4bf75700f4a128cd76de32ae2f010, user_id=0eea65a1c3e3467fb8754f407865f3b9, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.653095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.666411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 762/1538] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:43 2022] PUT /identity/v3/projects/79f4bf75700f4a128cd76de32ae2f010/users/0eea65a1c3e3467fb8754f407865f3b9/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:43.678429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee237566-0961-4c85-b7f6-4c25f0eddd8e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.678714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee237566-0961-4c85-b7f6-4c25f0eddd8e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.678998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee237566-0961-4c85-b7f6-4c25f0eddd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.695259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.715855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ee237566-0961-4c85-b7f6-4c25f0eddd8e None None] MFA Rules not processed for user `0eea65a1c3e3467fb8754f407865f3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:43.717056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ee237566-0961-4c85-b7f6-4c25f0eddd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:43.767324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2749d-5c71-4ab8-9234-571bc46ba42f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.772239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:43.772992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.773344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.773689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] PATH_INFO: `/v3/users/83bff425755f49a887b8b2badeaa80c1` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.775100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bff425755f49a887b8b2badeaa80c1)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:43.778967 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:43.810710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 777/1539] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:43.827523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee237566-0961-4c85-b7f6-4c25f0eddd8e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:43.841982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:43.856866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bff425755f49a887b8b2badeaa80c1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:43.858756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bff425755f49a887b8b2badeaa80c1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:43.891543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bff425755f49a887b8b2badeaa80c1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:43.907251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bff425755f49a887b8b2badeaa80c1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:43.923864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4e46501b-d54d-4216-92c3-cff127155fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bff425755f49a887b8b2badeaa80c1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:43.935127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 763/1540] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:43 2022] DELETE /identity/v3/users/83bff425755f49a887b8b2badeaa80c1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:43.936131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee237566-0961-4c85-b7f6-4c25f0eddd8e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:43.938405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:43.939121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:43.941319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:43.962426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:43.963925 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:44.036190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:44.077083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:44.077977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:44.078485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:44.078818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:44.082719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:44.085347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 764/1541] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:44.106080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:44.107618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:44.169314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:44.171445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:44.186132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 778/1542] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:44.199276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d1d92-adae-48de-8c83-9dda3e7e2b8a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:44.203145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:44.203982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:44.204268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:44.204545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:44.221595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:44.223191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:44.235584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 765/1543] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:44.886874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:44.889783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:44.915670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87ff6-15a3-485b-b090-16c58c4ac19c service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:44.935579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:44.935579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:44.935579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:44.935579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] PATH_INFO: `/v3/projects/3dbdc31ff4db46e5b4b7f752b61a0de2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:44.936884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbdc31ff4db46e5b4b7f752b61a0de2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:44.936884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:45.038465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbdc31ff4db46e5b4b7f752b61a0de2', 'request_id': 'req-453475db-b4af-40fe-a33e-5337d680ee44'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.046909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbdc31ff4db46e5b4b7f752b61a0de2', 'request_id': 'req-453475db-b4af-40fe-a33e-5337d680ee44'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.066265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbdc31ff4db46e5b4b7f752b61a0de2', 'request_id': 'req-453475db-b4af-40fe-a33e-5337d680ee44'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.086014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] The token cache is being invalidate because project 3dbdc31ff4db46e5b4b7f752b61a0de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:45.086014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.087229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.099245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 779/1544] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:44 2022] DELETE /identity/v3/projects/3dbdc31ff4db46e5b4b7f752b61a0de2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:45.101694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:45.113632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb524a83-24b4-46ba-acfb-2bee498c18c7 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:45.173792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:45.188793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:45.189491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:45.189775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:45.190045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] PATH_INFO: `/v3/users/da2e9e62389d4009a68b61da0aa973eb` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:45.192625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2e9e62389d4009a68b61da0aa973eb)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:45.194898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:45.268482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2e9e62389d4009a68b61da0aa973eb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.269338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2e9e62389d4009a68b61da0aa973eb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.281904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2e9e62389d4009a68b61da0aa973eb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.302136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2e9e62389d4009a68b61da0aa973eb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.335262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2e9e62389d4009a68b61da0aa973eb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.345407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 766/1545] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:45 2022] DELETE /identity/v3/users/da2e9e62389d4009a68b61da0aa973eb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:45.720772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:45.732816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:45.802209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453475db-b4af-40fe-a33e-5337d680ee44 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:45.850787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:45.852440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:45.880602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:45.881323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:45.881611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:45.881935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] PATH_INFO: `/v3/projects/33e6afb09c594c039550a34253e34bd0` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:45.883570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e6afb09c594c039550a34253e34bd0)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:45.886499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:45.911478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:45.960786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e6afb09c594c039550a34253e34bd0', 'request_id': 'req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.970214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e6afb09c594c039550a34253e34bd0', 'request_id': 'req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:45.972280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2254ab-4ee2-4c06-bb17-425a57c00c16 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:45.981253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e6afb09c594c039550a34253e34bd0', 'request_id': 'req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.012061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] The token cache is being invalidate because project 33e6afb09c594c039550a34253e34bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:46.012061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.015777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8a5e5c28-4921-44d1-bc40-3c01ca8607fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.022649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 780/1546] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:45 2022] DELETE /identity/v3/projects/33e6afb09c594c039550a34253e34bd0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:46.024173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e18dc-5ec9-49d8-bafa-b09dd18ae6f6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.024460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e18dc-5ec9-49d8-bafa-b09dd18ae6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.024738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e18dc-5ec9-49d8-bafa-b09dd18ae6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.051680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-454e18dc-5ec9-49d8-bafa-b09dd18ae6f6 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:46.053404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-454e18dc-5ec9-49d8-bafa-b09dd18ae6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.079858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.080527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.081284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.081574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.084421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.150646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 781/1547] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:46.156057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:46.160749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659155-ba97-427d-b7a6-ca57db786864 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.161099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659155-ba97-427d-b7a6-ca57db786864 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.161386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659155-ba97-427d-b7a6-ca57db786864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.203731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.205260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.211578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5c659155-ba97-427d-b7a6-ca57db786864 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:46.213591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5c659155-ba97-427d-b7a6-ca57db786864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.225998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 782/1549] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:46.231932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c659155-ba97-427d-b7a6-ca57db786864 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.232197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 767/1549] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:46.248010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c659155-ba97-427d-b7a6-ca57db786864 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.254668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.255424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.256031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.256133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.256780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:46.257187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.258966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.289553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.291832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.311123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 783/1550] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:24:46.312456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.329943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7a2a1-384f-4da8-8549-fffbd7d69883 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.336721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe0836-1d7e-443e-9c8a-660c72ea6db3 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.338694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.339826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.339826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.340185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.340921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.344786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.345281 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.347273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.347887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.348445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] PATH_INFO: `/v3/users/64a53638f81d4dbdb859507ab743123c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.351791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a53638f81d4dbdb859507ab743123c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.357052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.422089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 784/1551] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:46 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:46.422089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.434644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.518392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a53638f81d4dbdb859507ab743123c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.523196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a53638f81d4dbdb859507ab743123c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.561954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a53638f81d4dbdb859507ab743123c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.580862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a53638f81d4dbdb859507ab743123c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.585768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87091383-019a-4d7b-887b-0b4360327d51 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.594611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.595436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.595436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.595667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] PATH_INFO: `/v3/users/078f3484e1c74302b9c11c15cc8dd352` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.597046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=078f3484e1c74302b9c11c15cc8dd352)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.599316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.601507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:46.611184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a53638f81d4dbdb859507ab743123c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.621956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 768/1552] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:46 2022] DELETE /identity/v3/users/64a53638f81d4dbdb859507ab743123c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:46.623446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.625850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.701279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078f3484e1c74302b9c11c15cc8dd352'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.702022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078f3484e1c74302b9c11c15cc8dd352'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.711253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078f3484e1c74302b9c11c15cc8dd352'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.727608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078f3484e1c74302b9c11c15cc8dd352'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.728931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1596f72b-31e9-4a5f-949d-aa18f4b2ac2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078f3484e1c74302b9c11c15cc8dd352'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:46.732848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4662e-66f0-4698-a630-09001321459a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.739326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246029f-2d15-4988-a157-f36512af095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.740401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246029f-2d15-4988-a157-f36512af095e admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.740886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246029f-2d15-4988-a157-f36512af095e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.741737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246029f-2d15-4988-a157-f36512af095e admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.743035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246029f-2d15-4988-a157-f36512af095e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.746140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246029f-2d15-4988-a157-f36512af095e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.748010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 785/1553] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:46 2022] DELETE /identity/v3/users/078f3484e1c74302b9c11c15cc8dd352 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:46.749529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.749819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.750137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.772227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:46.773510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.776483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 769/1554] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:46 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:46.778502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169726cf-e9c1-4ce3-946f-debd84cbfa13 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.779210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169726cf-e9c1-4ce3-946f-debd84cbfa13 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.780236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169726cf-e9c1-4ce3-946f-debd84cbfa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.805224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-169726cf-e9c1-4ce3-946f-debd84cbfa13 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:46.808248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-169726cf-e9c1-4ce3-946f-debd84cbfa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.840117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 786/1555] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:46.844330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.844330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.856875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d8d8c-6a72-4a31-9192-7ec319f934d7 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.861985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.862396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.862705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.862936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.863760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:46.864451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.867044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.881594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 787/1556] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:46.882688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.887193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.905637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 770/1557] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:46.908189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169726cf-e9c1-4ce3-946f-debd84cbfa13 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.925129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169726cf-e9c1-4ce3-946f-debd84cbfa13 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.929985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.930601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.930881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.931180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.931996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.933891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:46.946042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 771/1558] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:46.946955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:46.948716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:46.970269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7700d1-243d-4dff-aeaf-45b34b7868f5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:46.980020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:46.980653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:46.980916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:46.981186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:46.991306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:46.992750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:47.003968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 788/1559] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:47.004540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:47.015778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106140c9-d8f9-428a-9d56-bff6c6c1affa service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:47.018966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b33b3-79d1-46b0-86c1-ddf3547046d5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:47.022714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:47.023060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae070fc-c88b-422f-9d71-eb2001f6778f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:47.023770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae070fc-c88b-422f-9d71-eb2001f6778f service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.023878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.024054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae070fc-c88b-422f-9d71-eb2001f6778f service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.024160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.024240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae070fc-c88b-422f-9d71-eb2001f6778f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.024310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] PATH_INFO: `/v3/projects/7d1451e237af48a1b2064f972c857fa5/users/345f0979c22d484d93880d841ae416cf/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.036370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:47.038130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae070fc-c88b-422f-9d71-eb2001f6778f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:47.039843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae070fc-c88b-422f-9d71-eb2001f6778f service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:47.049688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1451e237af48a1b2064f972c857fa5, user_id=345f0979c22d484d93880d841ae416cf, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:47.055745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 772/1560] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:47.056744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:47.092983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 789/1561] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:47 2022] PUT /identity/v3/projects/7d1451e237af48a1b2064f972c857fa5/users/345f0979c22d484d93880d841ae416cf/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:47.094784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add770b0-2e67-406c-8cff-a53fbae855af None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.095070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add770b0-2e67-406c-8cff-a53fbae855af None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.095367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add770b0-2e67-406c-8cff-a53fbae855af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.133828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-add770b0-2e67-406c-8cff-a53fbae855af None None] MFA Rules not processed for user `345f0979c22d484d93880d841ae416cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:47.135119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-add770b0-2e67-406c-8cff-a53fbae855af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:47.263106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 773/1562] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:47.263813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:47.385272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73e9-2be1-4612-810d-bf1848a8ecaa admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:47.392921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:47.393762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.394403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.394873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.395982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:47.398698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:47.451182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 790/1563] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:47 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:47.452332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add770b0-2e67-406c-8cff-a53fbae855af None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:47.468768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add770b0-2e67-406c-8cff-a53fbae855af None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:47.619642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:47.620278 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.620556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.620828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.621489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:47.627101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:47.654017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:47.681349 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:47.687839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 774/1564] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:47 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:47.696644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:47.701462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:47.710275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e6b05-6584-42ab-9140-93aa6cb41a46 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:47.728975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692918-3ec7-4dd0-b9c5-71ba34c9ee84 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:47.733418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:47.734554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.734881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.735113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.735774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:47.743710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:47.745032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.745324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.745818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] PATH_INFO: `/v3/projects/a186b0a01e7e4b94a72f769ab848f939` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.747770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a186b0a01e7e4b94a72f769ab848f939)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:47.748137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:47.749748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:47.771467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 791/1565] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:47.773538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:47.780860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:47.807543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743848ea-e44a-4712-a28f-6d91d52fa716 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:47.878264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a186b0a01e7e4b94a72f769ab848f939', 'request_id': 'req-eea79ce3-079c-4fca-a742-f1096580b681'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:47.889674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a186b0a01e7e4b94a72f769ab848f939', 'request_id': 'req-eea79ce3-079c-4fca-a742-f1096580b681'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:47.906877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a186b0a01e7e4b94a72f769ab848f939', 'request_id': 'req-eea79ce3-079c-4fca-a742-f1096580b681'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:47.943820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] The token cache is being invalidate because project a186b0a01e7e4b94a72f769ab848f939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:47.944125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:47.944968 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-eea79ce3-079c-4fca-a742-f1096580b681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:47.948712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 775/1566] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:47 2022] DELETE /identity/v3/projects/a186b0a01e7e4b94a72f769ab848f939 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:47.951671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1cb7-4057-4ba1-a3c9-daf7685289ce None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.951974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1cb7-4057-4ba1-a3c9-daf7685289ce None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.952259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1cb7-4057-4ba1-a3c9-daf7685289ce None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.954345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 776/1567] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:24:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:24:47.954729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1cb7-4057-4ba1-a3c9-daf7685289ce None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:47.959106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-731f1cb7-4057-4ba1-a3c9-daf7685289ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:47.970644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:47.972705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:47.973309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:47.973746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] PATH_INFO: `/v3/projects/a80694b68443407d8b97f5054f5ec2c7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:47.975227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80694b68443407d8b97f5054f5ec2c7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:47.977624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:48.130929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80694b68443407d8b97f5054f5ec2c7', 'request_id': 'req-3f2d3826-4f53-4096-85ea-958151c1a694'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.130929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80694b68443407d8b97f5054f5ec2c7', 'request_id': 'req-3f2d3826-4f53-4096-85ea-958151c1a694'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.144688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80694b68443407d8b97f5054f5ec2c7', 'request_id': 'req-3f2d3826-4f53-4096-85ea-958151c1a694'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.146377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:48.162831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1cb7-4057-4ba1-a3c9-daf7685289ce None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:48.162963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] The token cache is being invalidate because project a80694b68443407d8b97f5054f5ec2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:48.163240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.164022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.178598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 792/1568] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:47 2022] DELETE /identity/v3/projects/a80694b68443407d8b97f5054f5ec2c7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:48.184466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:48.200787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.295627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbef36c-837c-4ed2-8e53-5a4f52eb77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:48.296319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbef36c-837c-4ed2-8e53-5a4f52eb77ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.296602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbef36c-837c-4ed2-8e53-5a4f52eb77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.296874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbef36c-837c-4ed2-8e53-5a4f52eb77ff admin admin] PATH_INFO: `/v3/projects/5e5499977cc1484889f3af4ee2643546/users/fce1181db77c4e04b9a4af87f84cd8c3/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.302105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d3826-4f53-4096-85ea-958151c1a694 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:48.309552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:48.310764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.311786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.312870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] PATH_INFO: `/v3/users/df4abcd9779c4106bebfeed608006387` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.314216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4abcd9779c4106bebfeed608006387)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:48.318318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:48.331147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbef36c-837c-4ed2-8e53-5a4f52eb77ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5499977cc1484889f3af4ee2643546, user_id=fce1181db77c4e04b9a4af87f84cd8c3, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:48.336018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbef36c-837c-4ed2-8e53-5a4f52eb77ff admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:48.363265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 777/1569] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:47 2022] PUT /identity/v3/projects/5e5499977cc1484889f3af4ee2643546/users/fce1181db77c4e04b9a4af87f84cd8c3/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:48.366839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.367370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.367646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.392091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:48.401081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:48.403258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.403888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4abcd9779c4106bebfeed608006387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.405672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4abcd9779c4106bebfeed608006387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.417308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4abcd9779c4106bebfeed608006387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.434898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4abcd9779c4106bebfeed608006387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.436765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4abcd9779c4106bebfeed608006387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.460595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 793/1570] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:48 2022] DELETE /identity/v3/users/df4abcd9779c4106bebfeed608006387 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:48.461739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:48.475577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.502426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 778/1571] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:48.503725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:48.505582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.589452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31011b-9ab2-4c4e-bcd8-290dc6162ec6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:48.592445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983ca09-f26c-4973-8f6a-f6c26ac96037 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:48.594667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:48.595421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.595703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.595976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] PATH_INFO: `/v3/users/25a269d98d8940e2bc6000c6bd13752f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.597158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a269d98d8940e2bc6000c6bd13752f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:48.598962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:48.599409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:48.600108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.600578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.601670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.602532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:48.605187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:48.617220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:48.621466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 779/1572] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:48.625891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:48.643205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9eb0-07e0-4068-81ef-a331b24a8e72 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:48.655207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1864c9-c8b9-4b78-a202-c84b4f3eca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:48.656259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1864c9-c8b9-4b78-a202-c84b4f3eca85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.656547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1864c9-c8b9-4b78-a202-c84b4f3eca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.656821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1864c9-c8b9-4b78-a202-c84b4f3eca85 admin admin] PATH_INFO: `/v3/projects/5e5499977cc1484889f3af4ee2643546/users/fce1181db77c4e04b9a4af87f84cd8c3/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.659047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1864c9-c8b9-4b78-a202-c84b4f3eca85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5499977cc1484889f3af4ee2643546, user_id=fce1181db77c4e04b9a4af87f84cd8c3, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:48.664397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1864c9-c8b9-4b78-a202-c84b4f3eca85 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:48.680223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a269d98d8940e2bc6000c6bd13752f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.681184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 780/1573] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:48 2022] PUT /identity/v3/projects/5e5499977cc1484889f3af4ee2643546/users/fce1181db77c4e04b9a4af87f84cd8c3/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:48.681470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a269d98d8940e2bc6000c6bd13752f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.691738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.692063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.692400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.694307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a269d98d8940e2bc6000c6bd13752f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.722436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a269d98d8940e2bc6000c6bd13752f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.723361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a269d98d8940e2bc6000c6bd13752f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:48.747509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] MFA Rules not processed for user `fce1181db77c4e04b9a4af87f84cd8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:48.749891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.758070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 794/1574] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:48 2022] DELETE /identity/v3/users/25a269d98d8940e2bc6000c6bd13752f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:48.758997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:48.764225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.854549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 781/1575] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:48.867957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:48.870190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.879727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe023-831b-419e-b19a-277324a48ca3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:48.882260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:48.889000 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:48.889913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:48.890455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:48.890735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:48.894971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:48.918857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:48.921087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:48.963707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 795/1576] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:48.988389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca13ef-b2ac-4e34-9426-138dbab7699c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:49.048806 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:49.050812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:49.118574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74201d39-b8d0-4c8b-93e5-4df8c4e0fd81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:49.123913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201d39-b8d0-4c8b-93e5-4df8c4e0fd81 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.125244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201d39-b8d0-4c8b-93e5-4df8c4e0fd81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.125244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201d39-b8d0-4c8b-93e5-4df8c4e0fd81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.130085 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-74201d39-b8d0-4c8b-93e5-4df8c4e0fd81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:49.152686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d987c9-ac3a-4d84-a851-220f54475ea0 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:49.158692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:49.159541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.159927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.160307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] PATH_INFO: `/v3/projects/ecccffb7307d428b8753ef3174115357` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.161763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecccffb7307d428b8753ef3174115357)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:49.163829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:49.201702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:49.251579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecccffb7307d428b8753ef3174115357', 'request_id': 'req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.279716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecccffb7307d428b8753ef3174115357', 'request_id': 'req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.295441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecccffb7307d428b8753ef3174115357', 'request_id': 'req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.303126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74201d39-b8d0-4c8b-93e5-4df8c4e0fd81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:49.304601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74201d39-b8d0-4c8b-93e5-4df8c4e0fd81 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:49.316178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 782/1577] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:49.319868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] The token cache is being invalidate because project ecccffb7307d428b8753ef3174115357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:49.320653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.321667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48a7d3b8-ec35-440e-8dcd-7800de5b3cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.327126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 796/1578] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:49 2022] DELETE /identity/v3/projects/ecccffb7307d428b8753ef3174115357 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:49.332734 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361094b7-9c52-4585-89ff-c1fd5c011978 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.333237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361094b7-9c52-4585-89ff-c1fd5c011978 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.333555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361094b7-9c52-4585-89ff-c1fd5c011978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.376152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-361094b7-9c52-4585-89ff-c1fd5c011978 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:49.377545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-361094b7-9c52-4585-89ff-c1fd5c011978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:49.526008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 783/1579] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:49.536368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.537334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.537618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.596116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:49.597333 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:49.628390 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 797/1580] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:49.630929 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361094b7-9c52-4585-89ff-c1fd5c011978 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:49.644904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361094b7-9c52-4585-89ff-c1fd5c011978 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:49.658445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:49.660820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:49.661896 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:49.663226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.663735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.665068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.666558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:49.669887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:49.673756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:49.691763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43170a-d3e2-4fa0-856f-2d79c522833d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:49.710161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 784/1581] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:49.711528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:49.712380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:49.712988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.714486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.714870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] PATH_INFO: `/v3/projects/2269dc8bcdc94363bb8381dbe706e538` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.719888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2269dc8bcdc94363bb8381dbe706e538)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:49.724699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:49.727914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:49.750721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6edf5-6c3f-44e0-aee8-f25061c75f7a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:49.767678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:49.768332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.768619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.768899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.769562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:49.773650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:49.835289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 785/1582] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:49 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:49.840578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:49.846448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2269dc8bcdc94363bb8381dbe706e538', 'request_id': 'req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.864230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2269dc8bcdc94363bb8381dbe706e538', 'request_id': 'req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.876547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2269dc8bcdc94363bb8381dbe706e538', 'request_id': 'req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.910410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] The token cache is being invalidate because project 2269dc8bcdc94363bb8381dbe706e538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:49.910679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.913550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2126a7fc-4556-4b8f-af3a-fc91b4d618ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:49.922607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 798/1583] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:49 2022] DELETE /identity/v3/projects/2269dc8bcdc94363bb8381dbe706e538 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:49.927752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4deb3-3be3-479d-9277-facfded461b7 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:49.928039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4deb3-3be3-479d-9277-facfded461b7 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:49.928473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4deb3-3be3-479d-9277-facfded461b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:49.982964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c9c4deb3-3be3-479d-9277-facfded461b7 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:49.984534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c9c4deb3-3be3-479d-9277-facfded461b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:50.026993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45f134-bce6-420f-beab-402bf524fb04 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.044374 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.046307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.046591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.046868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.050986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.060032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.109564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 786/1584] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:49 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:50.116172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.119249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:50.139134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a349-d323-4478-bacb-b603d45fd7e7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.144885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.145671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.145954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.146273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.147725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.149545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.173623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 787/1585] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:50.174870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.207061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a9193-9185-4c03-bdce-ab5c6420f12c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.222525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.223187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.223471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.223747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.224815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.226182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.226506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 799/1586] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:50.232412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ebf70-7006-401b-9543-a2858af8f540 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.232828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ebf70-7006-401b-9543-a2858af8f540 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.233209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ebf70-7006-401b-9543-a2858af8f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.250786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 788/1587] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:50.251797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.272125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-200ebf70-7006-401b-9543-a2858af8f540 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:50.273507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-200ebf70-7006-401b-9543-a2858af8f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:50.276376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48919-d887-48a7-a665-ec0dd4b64b38 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.282044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.282811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.283162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.283390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] PATH_INFO: `/v3/projects/13e5f9b3fc3b4e818431c25b7bf6e320/users/3a3c0bd1fbf94fe18e0ffc012d8e1d24/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.284776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 800/1588] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:50.292114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ebf70-7006-401b-9543-a2858af8f540 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.300144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e5f9b3fc3b4e818431c25b7bf6e320, user_id=3a3c0bd1fbf94fe18e0ffc012d8e1d24, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.302567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ebf70-7006-401b-9543-a2858af8f540 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.303422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.310165 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8a0a1-ebec-4bfb-b254-b0db07f01be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.310875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a0a1-ebec-4bfb-b254-b0db07f01be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.311171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a0a1-ebec-4bfb-b254-b0db07f01be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.311469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a0a1-ebec-4bfb-b254-b0db07f01be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.312101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8a0a1-ebec-4bfb-b254-b0db07f01be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:50.312438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8a0a1-ebec-4bfb-b254-b0db07f01be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.314212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8a0a1-ebec-4bfb-b254-b0db07f01be9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.323415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 789/1589] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:50 2022] PUT /identity/v3/projects/13e5f9b3fc3b4e818431c25b7bf6e320/users/3a3c0bd1fbf94fe18e0ffc012d8e1d24/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:50.333777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.334080 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 801/1590] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:50.336671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af005d7-8875-4329-9ada-3f200ef8cbfc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.337028 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af005d7-8875-4329-9ada-3f200ef8cbfc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.337377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af005d7-8875-4329-9ada-3f200ef8cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.347335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:50.410917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1af005d7-8875-4329-9ada-3f200ef8cbfc None None] MFA Rules not processed for user `3a3c0bd1fbf94fe18e0ffc012d8e1d24`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:50.412366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1af005d7-8875-4329-9ada-3f200ef8cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:50.417842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920066-2573-4abb-bc43-54cd235fd855 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.423053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.423723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.424009 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.424728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.424940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.426923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.468341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 790/1591] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/projects => generated 407 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:50.472522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.486592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:50.509244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 802/1592] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:50.510897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af005d7-8875-4329-9ada-3f200ef8cbfc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.522492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af005d7-8875-4329-9ada-3f200ef8cbfc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.548989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37932df2-8873-45ea-b305-20a5014c9032 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.554186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.554809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.555195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.555544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.556825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.559180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.594921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 791/1593] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/users => generated 304 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:24:50.595048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.595048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.595048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.595048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.595394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.597078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.597739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.612066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe7f17-76f3-4c4a-9f7a-0a59b0677b66 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.618230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.620212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.620608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.620920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.621885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.623826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.638318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 803/1594] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:50.638318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.638318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:50.643106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 792/1595] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:50.644141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.657846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6e9ef-89ab-4afb-80a3-00af5a91fc8a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.716173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac26116-7a44-4341-b14f-599e6b789247 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.721207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.722288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.722681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.723047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] PATH_INFO: `/v3/users/a712799e982f41cf94f163c8688de6a4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.724337 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a712799e982f41cf94f163c8688de6a4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.726372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.736533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.737588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.737588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.737777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.738362 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.740364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.752468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:50.767241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 793/1596] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:50.771178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.782552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40e34-262e-4e14-910d-2f84bcb609ab admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.787715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.788392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.788674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.788954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.803434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.803434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.803434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 794/1597] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:50.803434 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.811190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a712799e982f41cf94f163c8688de6a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:50.811993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a712799e982f41cf94f163c8688de6a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:50.817545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca21d6-56fc-4c80-bb25-541f9f721959 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.820256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a712799e982f41cf94f163c8688de6a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:50.825059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.826040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.826319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.827343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.827999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.829598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.835158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a712799e982f41cf94f163c8688de6a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:50.835919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a712799e982f41cf94f163c8688de6a4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:50.841050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 795/1598] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:50.842071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.844362 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:50.853676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 804/1599] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:50 2022] DELETE /identity/v3/users/a712799e982f41cf94f163c8688de6a4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:50.854429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:50.857277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921ea22-346c-4f2b-9eac-a6e3c1eaa940 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.857537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:50.910772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:50.918950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4d92d-f3e3-4b46-9001-5c2b5f8dca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.919725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d92d-f3e3-4b46-9001-5c2b5f8dca53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.920075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d92d-f3e3-4b46-9001-5c2b5f8dca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.920891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4d92d-f3e3-4b46-9001-5c2b5f8dca53 admin admin] PATH_INFO: `/v3/projects/81f056ed8e1544218d11dddcd27e1c98/users/ab7f402bc6f74e81ad3a2c0e88d3f6cd/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.930764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f92227-ee84-42fe-a814-473e5ec196ad admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:50.938079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137b0f-17a3-4c6f-b708-1435cc6b6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:50.938777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137b0f-17a3-4c6f-b708-1435cc6b6b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.939062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137b0f-17a3-4c6f-b708-1435cc6b6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.939302 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d92d-f3e3-4b46-9001-5c2b5f8dca53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f056ed8e1544218d11dddcd27e1c98, user_id=ab7f402bc6f74e81ad3a2c0e88d3f6cd, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.939411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137b0f-17a3-4c6f-b708-1435cc6b6b50 admin admin] PATH_INFO: `/v3/projects/7d6f3a47302f4b1a83e40660704b91c9/users/03793d3cf9b94f3392083824deba5e8c/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.942153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4d92d-f3e3-4b46-9001-5c2b5f8dca53 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.955463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137b0f-17a3-4c6f-b708-1435cc6b6b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d6f3a47302f4b1a83e40660704b91c9, user_id=03793d3cf9b94f3392083824deba5e8c, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:50.956967 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 796/1600] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:50 2022] PUT /identity/v3/projects/81f056ed8e1544218d11dddcd27e1c98/users/ab7f402bc6f74e81ad3a2c0e88d3f6cd/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:50.958846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137b0f-17a3-4c6f-b708-1435cc6b6b50 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:50.965007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12a93-3a35-4164-8a97-78d20d0446ed None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.965771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12a93-3a35-4164-8a97-78d20d0446ed None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.966088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12a93-3a35-4164-8a97-78d20d0446ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.976153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 805/1601] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:50 2022] PUT /identity/v3/projects/7d6f3a47302f4b1a83e40660704b91c9/users/03793d3cf9b94f3392083824deba5e8c/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:50.977735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:50.978768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:50.979223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:50.990886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-79e12a93-3a35-4164-8a97-78d20d0446ed None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:50.992563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-79e12a93-3a35-4164-8a97-78d20d0446ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:51.019230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] MFA Rules not processed for user `ab7f402bc6f74e81ad3a2c0e88d3f6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:51.020531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:51.103112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 797/1602] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:51.103112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e12a93-3a35-4164-8a97-78d20d0446ed None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.120826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 806/1603] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:51.121786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.125130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:51.149803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e12a93-3a35-4164-8a97-78d20d0446ed None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.155161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:51.167896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.168886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.169309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.169725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.170783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.175963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.205803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 798/1604] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:51.207543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.224347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af06315-c595-4cc0-830b-a062f277ec7c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.255435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.257003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.259973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.267524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.268238 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.270701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.300687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742ea41-2e87-436c-b049-48254db26ea6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.307990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.308638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.308914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.309191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.327216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 799/1605] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:51 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:51.327216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.346748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.348654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.364119 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 807/1606] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:51.365106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.380496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0380eb-41b0-4fd4-a631-acb2d4a48a55 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.458561 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b45b8d-ec03-46bb-9c82-cd69e76ae13c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.479003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972061c-379d-4e07-aa25-f54449fae8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.480354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972061c-379d-4e07-aa25-f54449fae8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.480777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972061c-379d-4e07-aa25-f54449fae8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.481120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972061c-379d-4e07-aa25-f54449fae8ba admin admin] PATH_INFO: `/v3/projects/7d6f3a47302f4b1a83e40660704b91c9/users/03793d3cf9b94f3392083824deba5e8c/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.485002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972061c-379d-4e07-aa25-f54449fae8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d6f3a47302f4b1a83e40660704b91c9, user_id=03793d3cf9b94f3392083824deba5e8c, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.488156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972061c-379d-4e07-aa25-f54449fae8ba admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.510554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 800/1607] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:51 2022] PUT /identity/v3/projects/7d6f3a47302f4b1a83e40660704b91c9/users/03793d3cf9b94f3392083824deba5e8c/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:51.513136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.513522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.514599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.537306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.538228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.539352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.539641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.541204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.546402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.568236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] MFA Rules not processed for user `03793d3cf9b94f3392083824deba5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:51.569902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:51.619959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 808/1608] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:51 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:51.626794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.642458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52834-6d14-4105-92ae-486bef358bfa admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.653237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:51.709326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 801/1609] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:51.725631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.727886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:51.803814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.804446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.804735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.805009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.805663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.810895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.836873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 809/1610] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:51.843398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.859040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914bb16-dfe1-4042-8a0b-f1cffdf2d1e9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.864678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.865426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.865925 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.866398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.869597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024904-e0a8-4d79-b161-f92ee47b6e35 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.880006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.880397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:51.881098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:51.881375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:51.881769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] PATH_INFO: `/v3/projects/c4e2db7024644f42a00454af0878e74a/users/cbc1b841074d47b19507c98e75a439f6/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:51.882105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.895219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 802/1611] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:51.917001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e2db7024644f42a00454af0878e74a, user_id=cbc1b841074d47b19507c98e75a439f6, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:51.919980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:51.937994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 810/1612] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:51 2022] PUT /identity/v3/projects/c4e2db7024644f42a00454af0878e74a/users/cbc1b841074d47b19507c98e75a439f6/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:51.941624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:51.952973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d5caf-d107-496a-97ac-6573098f6004 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:51.990479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.006415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:52.023860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.024658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.025081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.025455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.026215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:52.027984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:52.039369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 803/1613] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:52.044217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.054582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e97668-04d5-4874-8803-f9fe41ee9bb1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:52.060611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5669686-e92c-415a-bb2e-993b1571312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.061363 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5669686-e92c-415a-bb2e-993b1571312d admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.061751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5669686-e92c-415a-bb2e-993b1571312d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.062170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5669686-e92c-415a-bb2e-993b1571312d admin admin] PATH_INFO: `/v3/projects/c4e2db7024644f42a00454af0878e74a/users/cbc1b841074d47b19507c98e75a439f6/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.064286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5669686-e92c-415a-bb2e-993b1571312d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e2db7024644f42a00454af0878e74a, user_id=cbc1b841074d47b19507c98e75a439f6, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:52.066582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507fb7c-6b85-42ff-a9cd-4a3aad6741c7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:52.067296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5669686-e92c-415a-bb2e-993b1571312d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:52.070958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.071648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.072566 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.072850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.074967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.080548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 804/1614] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:52 2022] PUT /identity/v3/projects/c4e2db7024644f42a00454af0878e74a/users/cbc1b841074d47b19507c98e75a439f6/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:52.092701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.093094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.093486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.134761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] MFA Rules not processed for user `cbc1b841074d47b19507c98e75a439f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:52.136377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.159363 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:52.160807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:52.171640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 811/1615] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:52.193500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.195567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.215333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:52.240441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cfce6-a509-48b9-9977-a8899e79abba service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:52.262496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 805/1616] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:52.274075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.276633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.318468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.319338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.319635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.319919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] PATH_INFO: `/v3/projects/159918898ae64c4da9460d772c29f5b0` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.321032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] RBAC: Authorizing `identity:delete_project(project_id=159918898ae64c4da9460d772c29f5b0)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:52.323206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:52.346951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931429a1-7145-4536-b595-815e35f1cac0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:52.351164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.351791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.352077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.352357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.362564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:52.364119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:52.375766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 806/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:52.379994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159918898ae64c4da9460d772c29f5b0', 'request_id': 'req-854b0b56-b548-4446-bad2-522a7181514b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.387250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159918898ae64c4da9460d772c29f5b0', 'request_id': 'req-854b0b56-b548-4446-bad2-522a7181514b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.397621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159918898ae64c4da9460d772c29f5b0', 'request_id': 'req-854b0b56-b548-4446-bad2-522a7181514b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.417227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:52.422589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] The token cache is being invalidate because project 159918898ae64c4da9460d772c29f5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:52.422893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.423835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.426126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 812/1618] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:52 2022] DELETE /identity/v3/projects/159918898ae64c4da9460d772c29f5b0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:52.431535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.442351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f91397-dfd2-4453-8332-c6405f2b3da2 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:52.487775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.489374 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.523946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.526711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.526998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.527305 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] PATH_INFO: `/v3/users/0eea65a1c3e3467fb8754f407865f3b9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.530651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eea65a1c3e3467fb8754f407865f3b9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:52.534413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:52.579796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0b56-b548-4446-bad2-522a7181514b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:52.586808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.588494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.588892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.589271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] PATH_INFO: `/v3/users/3a3c0bd1fbf94fe18e0ffc012d8e1d24` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.590588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3c0bd1fbf94fe18e0ffc012d8e1d24)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:52.593239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:52.608820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eea65a1c3e3467fb8754f407865f3b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.610322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eea65a1c3e3467fb8754f407865f3b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.619487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eea65a1c3e3467fb8754f407865f3b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.631886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eea65a1c3e3467fb8754f407865f3b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.660433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eea65a1c3e3467fb8754f407865f3b9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.665687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:52.666776 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3c0bd1fbf94fe18e0ffc012d8e1d24'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.668874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3c0bd1fbf94fe18e0ffc012d8e1d24'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.678295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 807/1619] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:52 2022] DELETE /identity/v3/users/0eea65a1c3e3467fb8754f407865f3b9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:52.678295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.690649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.700255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3c0bd1fbf94fe18e0ffc012d8e1d24'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.716701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3c0bd1fbf94fe18e0ffc012d8e1d24'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.717465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0e26d-add4-4326-b08c-37a614b0d598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3c0bd1fbf94fe18e0ffc012d8e1d24'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:52.737691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 813/1620] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:52 2022] DELETE /identity/v3/users/3a3c0bd1fbf94fe18e0ffc012d8e1d24 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:52.743494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.744083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.744343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.770430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:52.771677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.788640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94637f-874c-4006-ac68-5765da91b4af admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:52.905567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:52.906322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:52.906672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:52.907299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:52.909042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.917112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 814/1621] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:52.927385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:52.931166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:52.977500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:53.012478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.014082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.026244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 808/1622] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:53.026543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774a4fe-24c3-4bef-ad8d-f7d2e31233bc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.031630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97efea3-49a6-4caf-b4b2-36d8e55fbc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.032385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efea3-49a6-4caf-b4b2-36d8e55fbc51 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.032510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efea3-49a6-4caf-b4b2-36d8e55fbc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.032937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efea3-49a6-4caf-b4b2-36d8e55fbc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.044019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97efea3-49a6-4caf-b4b2-36d8e55fbc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.045586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97efea3-49a6-4caf-b4b2-36d8e55fbc51 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.057310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 815/1623] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:53.070515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.103121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:53.140834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43c620-50e2-4b4c-a790-a506293db355 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.149015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.149911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.150355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.150945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] PATH_INFO: `/v3/projects/79f4bf75700f4a128cd76de32ae2f010` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.152361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f4bf75700f4a128cd76de32ae2f010)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.154718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.250947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f4bf75700f4a128cd76de32ae2f010', 'request_id': 'req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.267647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f4bf75700f4a128cd76de32ae2f010', 'request_id': 'req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.296727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f4bf75700f4a128cd76de32ae2f010', 'request_id': 'req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.301175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:53.314837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] The token cache is being invalidate because project 79f4bf75700f4a128cd76de32ae2f010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:53.315127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.315816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a7ea6be2-50d0-4d6d-b979-bc2c3babaff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.320822 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 809/1624] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:53 2022] DELETE /identity/v3/projects/79f4bf75700f4a128cd76de32ae2f010 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:53.322474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb301-295a-44e5-9077-a792a437daf8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.323041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb301-295a-44e5-9077-a792a437daf8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.323041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb301-295a-44e5-9077-a792a437daf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.365885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d0dcb301-295a-44e5-9077-a792a437daf8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:53.367406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d0dcb301-295a-44e5-9077-a792a437daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:53.509164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 816/1625] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:53.517158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.517661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.517814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.548735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:53.549971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:53.594412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 810/1626] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:53.607108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcb301-295a-44e5-9077-a792a437daf8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.614618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcb301-295a-44e5-9077-a792a437daf8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.617568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.620763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.621235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:53.621539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.622155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.622443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.623126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:53.623441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.625172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.638602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9426-3dba-4f78-a6a0-4bd92cc289a2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.639248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 817/1627] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:53.644973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.648961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.649727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.650631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.651123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] PATH_INFO: `/v3/projects/13e5f9b3fc3b4e818431c25b7bf6e320` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.652531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e5f9b3fc3b4e818431c25b7bf6e320)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.656300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.661714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be47fee-5e6c-4342-85b8-4fc5b034a8a7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.669860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.670812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.671487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.671827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.672540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.674975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.730889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 818/1628] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:53 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:24:53.732186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.757231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e5f9b3fc3b4e818431c25b7bf6e320', 'request_id': 'req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.766610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e5f9b3fc3b4e818431c25b7bf6e320', 'request_id': 'req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.778473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e5f9b3fc3b4e818431c25b7bf6e320', 'request_id': 'req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.798943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] The token cache is being invalidate because project 13e5f9b3fc3b4e818431c25b7bf6e320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:53.799311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.800026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.801979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 811/1629] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:53 2022] DELETE /identity/v3/projects/13e5f9b3fc3b4e818431c25b7bf6e320 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:53.807339 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.808745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:53.823099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead10876-b0eb-410f-94ed-edbd7b985681 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.866121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:53.903928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cebba-ce4d-4689-ba9b-01ab5d208a43 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.910215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.910881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.911013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.911282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.911563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.912210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.913050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.913522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.913924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] PATH_INFO: `/v3/users/03793d3cf9b94f3392083824deba5e8c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.914395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.915600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03793d3cf9b94f3392083824deba5e8c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.919844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.944334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 819/1630] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:53 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:53.949190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.952643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:53.965989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05be00-e4b3-44f4-ac7d-be1f991fc645 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:53.972822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:53.973590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:53.974008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:53.974382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:53.976362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:53.978102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:53.989737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 820/1631] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:53.993476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03793d3cf9b94f3392083824deba5e8c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:53.993732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:53.994822 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03793d3cf9b94f3392083824deba5e8c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.003421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03793d3cf9b94f3392083824deba5e8c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.015016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03793d3cf9b94f3392083824deba5e8c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.024960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f396-da34-4d78-ac23-d7d665f937eb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.027992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:54.031206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.033054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.033550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.034320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.035252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.037347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.045025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6844bc65-6c4a-4e20-b2b6-01324ca97bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03793d3cf9b94f3392083824deba5e8c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.054361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 821/1632] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:54.058826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.060451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 812/1633] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:53 2022] DELETE /identity/v3/users/03793d3cf9b94f3392083824deba5e8c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:54.068167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.085381 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9be83-a6a3-4958-843e-730af9c9f2e1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.165163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.166220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.166510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.166903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] PATH_INFO: `/v3/projects/e95c51edebe34ae4b26edb5c9e2130f7/users/78b3153e38d64882bd5193deaf909ba0/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.188179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95c51edebe34ae4b26edb5c9e2130f7, user_id=78b3153e38d64882bd5193deaf909ba0, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.191591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.232382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 822/1634] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:54 2022] PUT /identity/v3/projects/e95c51edebe34ae4b26edb5c9e2130f7/users/78b3153e38d64882bd5193deaf909ba0/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:54.234924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896f881-2686-4948-942b-3735a2c3800b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.235264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896f881-2686-4948-942b-3735a2c3800b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.235648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896f881-2686-4948-942b-3735a2c3800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.294482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4896f881-2686-4948-942b-3735a2c3800b None None] MFA Rules not processed for user `78b3153e38d64882bd5193deaf909ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:54.295775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4896f881-2686-4948-942b-3735a2c3800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.377436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 813/1635] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:54.381998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.384357 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896f881-2686-4948-942b-3735a2c3800b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.386542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4896f881-2686-4948-942b-3735a2c3800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.470959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c957d-74e6-4e2e-bd2b-42d707299e8a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.476445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.477170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.477459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.477731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.478415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.480081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896f881-2686-4948-942b-3735a2c3800b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.480362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.488089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.488734 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.489011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.489286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] PATH_INFO: `/v3/projects/7d6f3a47302f4b1a83e40660704b91c9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.490440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d6f3a47302f4b1a83e40660704b91c9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.492492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.515180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 823/1636] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:54 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:54.516848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.518572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.529032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:54.542064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d6f3a47302f4b1a83e40660704b91c9', 'request_id': 'req-f02921e2-e421-4038-8718-24eaf7f72f21'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.549193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d6f3a47302f4b1a83e40660704b91c9', 'request_id': 'req-f02921e2-e421-4038-8718-24eaf7f72f21'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.559965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d6f3a47302f4b1a83e40660704b91c9', 'request_id': 'req-f02921e2-e421-4038-8718-24eaf7f72f21'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.589190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] The token cache is being invalidate because project 7d6f3a47302f4b1a83e40660704b91c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:54.589494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.590190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:54.591648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7fc1a-3f5d-481c-990f-ae9fcdc75dc6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.592077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 814/1637] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:54 2022] DELETE /identity/v3/projects/7d6f3a47302f4b1a83e40660704b91c9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:54.593483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.595270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.609600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:54.695717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02921e2-e421-4038-8718-24eaf7f72f21 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.701651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e9935-84b1-4c8d-867f-c63dbdf1f712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.702592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9935-84b1-4c8d-867f-c63dbdf1f712 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.702713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12450e2-8bc7-49fc-a84b-bfe47ba3ab67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.703169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9935-84b1-4c8d-867f-c63dbdf1f712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.703375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12450e2-8bc7-49fc-a84b-bfe47ba3ab67 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.703882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9935-84b1-4c8d-867f-c63dbdf1f712 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.703993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12450e2-8bc7-49fc-a84b-bfe47ba3ab67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.703993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12450e2-8bc7-49fc-a84b-bfe47ba3ab67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.704409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e9935-84b1-4c8d-867f-c63dbdf1f712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.706284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b12450e2-8bc7-49fc-a84b-bfe47ba3ab67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.706547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e9935-84b1-4c8d-867f-c63dbdf1f712 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.745080 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 815/1638] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:54 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:54.746933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0c741-d3a6-4638-9519-f566f3c6a52a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.747368 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0c741-d3a6-4638-9519-f566f3c6a52a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.747653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0c741-d3a6-4638-9519-f566f3c6a52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.772092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fcc0c741-d3a6-4638-9519-f566f3c6a52a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:54.774693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fcc0c741-d3a6-4638-9519-f566f3c6a52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.784546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 816/1639] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:54.785787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0c741-d3a6-4638-9519-f566f3c6a52a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.799258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0c741-d3a6-4638-9519-f566f3c6a52a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.807664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.808375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.809312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.809312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.809821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12450e2-8bc7-49fc-a84b-bfe47ba3ab67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.809948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.811407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12450e2-8bc7-49fc-a84b-bfe47ba3ab67 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.812030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.826297 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 824/1640] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:54.827623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d30e3-1c67-4f37-89f1-02e009436a6b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.827908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d30e3-1c67-4f37-89f1-02e009436a6b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.828183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d30e3-1c67-4f37-89f1-02e009436a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.851483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6b7d30e3-1c67-4f37-89f1-02e009436a6b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:54.853768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6b7d30e3-1c67-4f37-89f1-02e009436a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:54.857780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 817/1641] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:54.859204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.866432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 825/1642] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:54.867642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d30e3-1c67-4f37-89f1-02e009436a6b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.902902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7572a94-8e77-423f-8e13-7af8b572f92e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.909489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d30e3-1c67-4f37-89f1-02e009436a6b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.923345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.924293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.925790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.926425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.926791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.926996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] PATH_INFO: `/v3/projects/1147db61ac574ef98a796970fad9d54f/users/560e8d8b69cd4d0f90796502dfec06d3/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.928756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:54.928756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:54.929917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:54.930370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.933631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.954714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 826/1643] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:54.956348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:54.971335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1fd63-fb64-483b-b276-80a3d09d6adb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:54.992444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1147db61ac574ef98a796970fad9d54f, user_id=560e8d8b69cd4d0f90796502dfec06d3, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:54.995707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:54.996494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:54.997128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:54.999686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.000501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.001620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.003558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.054568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 818/1644] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:54 2022] PUT /identity/v3/projects/1147db61ac574ef98a796970fad9d54f/users/560e8d8b69cd4d0f90796502dfec06d3/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:55.059064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.074494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 827/1645] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:54 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:55.078258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.163592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0929-2df1-457a-b51c-c9327621771f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.177417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:55.243761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d740411-d45b-4721-8a22-359f89a5cbbe admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.255376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.256177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.257148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.258299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.260137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.266989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.274283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.277305 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.277604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.277890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.279160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.281211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.289750 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:55.305307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 819/1646] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:55.307651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.313048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 828/1647] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:55 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:55.316977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.329393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bd865-4884-4b2b-ac5c-10aa5a6aa4d0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.332243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d53c-14e4-4406-a133-c10be36ca5bd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.335507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.336571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.336571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.337050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.338287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.340241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.344548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3f03-4a90-4ea4-8de4-fb4773498a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.345250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3f03-4a90-4ea4-8de4-fb4773498a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.346664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3f03-4a90-4ea4-8de4-fb4773498a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.346961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3f03-4a90-4ea4-8de4-fb4773498a6f admin admin] PATH_INFO: `/v3/projects/1147db61ac574ef98a796970fad9d54f/users/560e8d8b69cd4d0f90796502dfec06d3/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.351711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 829/1648] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:24:55.352139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3f03-4a90-4ea4-8de4-fb4773498a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1147db61ac574ef98a796970fad9d54f, user_id=560e8d8b69cd4d0f90796502dfec06d3, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.356085 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.362951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e3f03-4a90-4ea4-8de4-fb4773498a6f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.369533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741269-f7c1-495b-9853-f5ed1a06080a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.381729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.382285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 820/1649] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:55 2022] PUT /identity/v3/projects/1147db61ac574ef98a796970fad9d54f/users/560e8d8b69cd4d0f90796502dfec06d3/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:55.382410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.382982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.383170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.383821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.386631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.392780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.393078 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.393358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.413999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 830/1650] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:55.414930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.428383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7c22f-1285-4d6d-abc4-45b05aebc2b3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.485151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] MFA Rules not processed for user `560e8d8b69cd4d0f90796502dfec06d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:55.489218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:55.526737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e503-e781-454c-a546-b79885029949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.528994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e503-e781-454c-a546-b79885029949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.530420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e503-e781-454c-a546-b79885029949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.530850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e503-e781-454c-a546-b79885029949 admin admin] PATH_INFO: `/v3/projects/9e2d5ce0c9724d85b164b45a6de72f23/users/a1f310a4138c4b24a80f01c3319b6bbd/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.575933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4e503-e781-454c-a546-b79885029949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2d5ce0c9724d85b164b45a6de72f23, user_id=a1f310a4138c4b24a80f01c3319b6bbd, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.584226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4e503-e781-454c-a546-b79885029949 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.625158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 831/1651] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:55 2022] PUT /identity/v3/projects/9e2d5ce0c9724d85b164b45a6de72f23/users/a1f310a4138c4b24a80f01c3319b6bbd/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:55.627742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42c6f-5cdc-463b-8789-96dabd3fc198 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.628157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42c6f-5cdc-463b-8789-96dabd3fc198 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.628501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42c6f-5cdc-463b-8789-96dabd3fc198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.639453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 821/1652] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:55.658046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.659556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:55.680299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-56e42c6f-5cdc-463b-8789-96dabd3fc198 None None] MFA Rules not processed for user `a1f310a4138c4b24a80f01c3319b6bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:55.682440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-56e42c6f-5cdc-463b-8789-96dabd3fc198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:55.750824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390eb6-f254-4949-8850-3738b66013cd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.777025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 832/1653] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:55.783016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42c6f-5cdc-463b-8789-96dabd3fc198 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.808316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:55.811637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.812287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.812573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.812850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.873360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:55.879792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42c6f-5cdc-463b-8789-96dabd3fc198 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:55.893621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:55.894726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:55.895308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:55.895778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:55.896943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.899732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.907144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:55.909852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:55.924176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 822/1654] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:55.945878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 833/1655] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:55 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:24:55.950640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:55.963316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22496f3-b568-4d46-b0a8-30e3d6416e2f service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.020839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.062573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.063536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.064022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.064403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.065192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.067534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.099411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 823/1656] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:55 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:56.102853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.115323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec1ab1-c5ce-4aff-bc22-5cd1e3c49b96 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.123126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.123850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.124452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.124840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.125756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.128051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.141760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 824/1657] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:24:56.144660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0359d-7812-4d96-9bbb-8feb65338389 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.147052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.152021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.153538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.154016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.154623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] PATH_INFO: `/v3/users/78b3153e38d64882bd5193deaf909ba0` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.156069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b3153e38d64882bd5193deaf909ba0)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.159019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.177026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f4d5-43bb-46bf-9687-7b4e11955f55 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.194093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.194876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.195343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.195715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.197112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.200743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.222768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 825/1658] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:56.229067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.244716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ac9ae-4459-4e2d-8faa-d158be124470 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.255045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa793c1e-e739-4945-bec5-49172310dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.256007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa793c1e-e739-4945-bec5-49172310dea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.256301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa793c1e-e739-4945-bec5-49172310dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.256581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa793c1e-e739-4945-bec5-49172310dea8 admin admin] PATH_INFO: `/v3/projects/3b49e6163e89464ea5b9b7c6e6f6972f/users/f58d70fde13141e19198e6c222006d6c/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.271643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b3153e38d64882bd5193deaf909ba0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:56.272679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b3153e38d64882bd5193deaf909ba0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:56.278191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa793c1e-e739-4945-bec5-49172310dea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b49e6163e89464ea5b9b7c6e6f6972f, user_id=f58d70fde13141e19198e6c222006d6c, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.282643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa793c1e-e739-4945-bec5-49172310dea8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.285657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b3153e38d64882bd5193deaf909ba0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:56.305067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 826/1659] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:56 2022] PUT /identity/v3/projects/3b49e6163e89464ea5b9b7c6e6f6972f/users/f58d70fde13141e19198e6c222006d6c/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:56.316104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b3153e38d64882bd5193deaf909ba0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:56.317236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.318014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.318471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.318712 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bb4085ea-7db3-4cfe-8f26-698a2357a67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b3153e38d64882bd5193deaf909ba0'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:56.344605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 834/1660] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:56 2022] DELETE /identity/v3/users/78b3153e38d64882bd5193deaf909ba0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:56.346860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.348215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.348498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.383349 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] MFA Rules not processed for user `f58d70fde13141e19198e6c222006d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:56.383349 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:56.392846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:56.394150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:56.435819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:56.504772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 827/1661] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:56.506939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.511505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:56.556725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:56.591258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 835/1662] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:56.600697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.602598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:56.695843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0703151-6ada-437e-8cd6-163be72d9041 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.703104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.704632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.705351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.705462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4567b-3dc0-4970-9140-8975e08c9c9f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.706395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.710664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.711325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.711604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.712067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.713258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.715639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.721137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.723974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.740119 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 836/1663] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:56.760721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 828/1664] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:56 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:56.761666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.778116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0b5cd-bb74-4f89-96dd-95bcc340b250 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.881259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.881892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.882261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.882453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.883130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.885128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.930884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 837/1665] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:56 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:24:56.933268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:56.951385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e805e70-c91d-464a-9699-1793727e0c47 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:56.958815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:56.959756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:56.960489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:56.961036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:56.961903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:56.964680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:56.991131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 829/1666] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:56.993013 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:57.005740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68d32f-dba7-45e3-a631-11beb0e7e67a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:57.013187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:57.015030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:57.015030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:57.015245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] PATH_INFO: `/v3/projects/7c0363d17fd2486984a16c7c56269d8b/users/05b6e5aae4f8448a8e2c15669450a751/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:57.041121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0363d17fd2486984a16c7c56269d8b, user_id=05b6e5aae4f8448a8e2c15669450a751, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:57.044330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:57.076582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 838/1667] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:56 2022] PUT /identity/v3/projects/7c0363d17fd2486984a16c7c56269d8b/users/05b6e5aae4f8448a8e2c15669450a751/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:57.079538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:57.095788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d63be7-de78-4b6b-9cef-bd4496cf4be5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:57.248317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:57.248962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:57.249240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:57.249583 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:57.250244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:57.251919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:57.272015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:57.273662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:57.294439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 830/1668] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:57.295397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:57.296154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd24a23-d0ca-4a88-afe7-eb4b0de81047 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:57.305598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:57.307632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:57.307977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:57.308241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] PATH_INFO: `/v3/projects/e95c51edebe34ae4b26edb5c9e2130f7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:57.310815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95c51edebe34ae4b26edb5c9e2130f7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:57.312888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:57.317268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a535470-c503-42d8-8c5d-4eaab6d28cf1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:57.324879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a038a90-c13a-4574-8a57-3aa6f607716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:57.325546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a038a90-c13a-4574-8a57-3aa6f607716f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:57.325827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a038a90-c13a-4574-8a57-3aa6f607716f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:57.326643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a038a90-c13a-4574-8a57-3aa6f607716f admin admin] PATH_INFO: `/v3/projects/7c0363d17fd2486984a16c7c56269d8b/users/05b6e5aae4f8448a8e2c15669450a751/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:57.328923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a038a90-c13a-4574-8a57-3aa6f607716f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0363d17fd2486984a16c7c56269d8b, user_id=05b6e5aae4f8448a8e2c15669450a751, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:57.332007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a038a90-c13a-4574-8a57-3aa6f607716f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:57.345544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 831/1669] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:57 2022] PUT /identity/v3/projects/7c0363d17fd2486984a16c7c56269d8b/users/05b6e5aae4f8448a8e2c15669450a751/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:57.357845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:57.358179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:57.358427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:57.372484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:57.401143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] MFA Rules not processed for user `05b6e5aae4f8448a8e2c15669450a751`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:57.403900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:57.413247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95c51edebe34ae4b26edb5c9e2130f7', 'request_id': 'req-d14d7b94-c010-487f-9620-2b2b56edb934'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.426184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95c51edebe34ae4b26edb5c9e2130f7', 'request_id': 'req-d14d7b94-c010-487f-9620-2b2b56edb934'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.436521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95c51edebe34ae4b26edb5c9e2130f7', 'request_id': 'req-d14d7b94-c010-487f-9620-2b2b56edb934'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.456422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] The token cache is being invalidate because project e95c51edebe34ae4b26edb5c9e2130f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:57.456691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.457403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.459584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 839/1670] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:57 2022] DELETE /identity/v3/projects/e95c51edebe34ae4b26edb5c9e2130f7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:57.464522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:57.469875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:57.485207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:57.501230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 832/1671] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:57.518960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:57.521902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:57.559853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7b94-c010-487f-9620-2b2b56edb934 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:57.570537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:57.571228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:57.571515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:57.572341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] PATH_INFO: `/v3/users/560e8d8b69cd4d0f90796502dfec06d3` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:57.574441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560e8d8b69cd4d0f90796502dfec06d3)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:57.577378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:57.645615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b1666-05b8-4821-bad3-9668b6cf545e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:57.662296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacd0fd-66f6-4464-b50a-54a107cadcd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:57.663171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd0fd-66f6-4464-b50a-54a107cadcd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:57.664173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd0fd-66f6-4464-b50a-54a107cadcd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:57.664631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd0fd-66f6-4464-b50a-54a107cadcd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:57.668713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-deacd0fd-66f6-4464-b50a-54a107cadcd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:57.676752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560e8d8b69cd4d0f90796502dfec06d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.677448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560e8d8b69cd4d0f90796502dfec06d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.687299 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560e8d8b69cd4d0f90796502dfec06d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.704002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560e8d8b69cd4d0f90796502dfec06d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.705174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560e8d8b69cd4d0f90796502dfec06d3'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:57.725446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 840/1672] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:24:57 2022] DELETE /identity/v3/users/560e8d8b69cd4d0f90796502dfec06d3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:24:57.775884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacd0fd-66f6-4464-b50a-54a107cadcd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:57.777594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacd0fd-66f6-4464-b50a-54a107cadcd7 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:57.803258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 833/1673] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:24:58.031659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:58.033171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:58.185073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:58.296687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362c3b-0e4c-4cbc-acf7-99224e026846 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:58.309779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:58.310856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:58.311305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:58.311711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] PATH_INFO: `/v3/projects/1147db61ac574ef98a796970fad9d54f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:58.314482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1147db61ac574ef98a796970fad9d54f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:58.319500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:58.426164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1147db61ac574ef98a796970fad9d54f', 'request_id': 'req-d28b3417-3bde-4028-a1b1-b6157b268fcf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:58.446592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1147db61ac574ef98a796970fad9d54f', 'request_id': 'req-d28b3417-3bde-4028-a1b1-b6157b268fcf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:58.468063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1147db61ac574ef98a796970fad9d54f', 'request_id': 'req-d28b3417-3bde-4028-a1b1-b6157b268fcf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:58.500674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] The token cache is being invalidate because project 1147db61ac574ef98a796970fad9d54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:24:58.501589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:58.502692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d28b3417-3bde-4028-a1b1-b6157b268fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:24:58.505491 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 841/1674] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:24:58 2022] DELETE /identity/v3/projects/1147db61ac574ef98a796970fad9d54f => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:58.514630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49c57b-4ff4-4c6b-9e0c-b972823079f0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:58.514957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49c57b-4ff4-4c6b-9e0c-b972823079f0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:58.515269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49c57b-4ff4-4c6b-9e0c-b972823079f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:58.555241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dc49c57b-4ff4-4c6b-9e0c-b972823079f0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:58.557729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dc49c57b-4ff4-4c6b-9e0c-b972823079f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:58.695786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 834/1675] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:58.697850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba53a-15ab-41f3-a9eb-babf4aff1ec1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:58.698140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba53a-15ab-41f3-a9eb-babf4aff1ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:58.698796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba53a-15ab-41f3-a9eb-babf4aff1ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:58.728332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-317ba53a-15ab-41f3-a9eb-babf4aff1ec1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:58.729487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-317ba53a-15ab-41f3-a9eb-babf4aff1ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:58.738801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 842/1676] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:24:58.743285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49c57b-4ff4-4c6b-9e0c-b972823079f0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:58.756678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49c57b-4ff4-4c6b-9e0c-b972823079f0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:58.763045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:58.764040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:58.764696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:58.764696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:58.765604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:24:58.766118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:58.768418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:58.783522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 835/1677] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:24:58.787846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ba53a-15ab-41f3-a9eb-babf4aff1ec1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:58.803249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ba53a-15ab-41f3-a9eb-babf4aff1ec1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:58.810211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:58.810837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:58.811168 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:58.811417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:58.812078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:58.814322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:58.854677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 843/1678] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:24:58 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:24:58.858834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:58.882830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1200fde-6fa3-48c0-bca1-f42f03de5eb4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:58.924640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:58.956203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:58.956827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:58.957113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:58.957390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:58.958050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:58.960046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:58.983021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 836/1679] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:24:58 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:24:58.987967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:59.000666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f193b5-b1d9-43d6-8008-e49c783734b9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:59.006034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:59.006943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:59.007573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:59.007795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:59.008445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:59.010675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:59.021533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 844/1680] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:59.026066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:59.037921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39625d14-7c97-4275-b0bd-6e8669a31ac9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:59.042681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7acd9d-33f2-4054-a21d-d9d5a2cd4e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:59.043365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7acd9d-33f2-4054-a21d-d9d5a2cd4e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:59.043649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7acd9d-33f2-4054-a21d-d9d5a2cd4e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:59.043918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7acd9d-33f2-4054-a21d-d9d5a2cd4e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:59.044565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7acd9d-33f2-4054-a21d-d9d5a2cd4e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:59.047029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7acd9d-33f2-4054-a21d-d9d5a2cd4e6c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:59.058758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 837/1681] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:24:59.063156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:59.073947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844a0b1-1b30-4f9e-a665-c73a33f8756a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:59.078731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:59.079656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:59.079945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:59.080228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] PATH_INFO: `/v3/projects/f9857f21c45f4a04bbf6ed293d8aa83c/users/8423bfc7ccda47579c70727ae5cd6c06/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:59.096754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9857f21c45f4a04bbf6ed293d8aa83c, user_id=8423bfc7ccda47579c70727ae5cd6c06, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:59.099456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:59.113104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 845/1682] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:24:59 2022] PUT /identity/v3/projects/f9857f21c45f4a04bbf6ed293d8aa83c/users/8423bfc7ccda47579c70727ae5cd6c06/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:24:59.126058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:59.126414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:59.126759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:59.182911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] MFA Rules not processed for user `8423bfc7ccda47579c70727ae5cd6c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:24:59.184171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:59.258227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 838/1683] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:24:59.266169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:59.268143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:59.337500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:59.364926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e3ac-f22b-4a27-a711-c4fc51c166db admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:59.369563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:59.371545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:59.371844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:59.372129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:59.384204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:59.385061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:24:59.385929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:59.386725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:59.411233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 846/1684] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:24:59.454960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaef0c1-af47-4a0b-ac26-30ef2515ab52 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:24:59.458607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:24:59.459268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:24:59.459553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:24:59.459830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:24:59.461696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:24:59.530183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:24:59.531677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:24:59.535598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:59.542138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 839/1685] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:25:00.223763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:00.225372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:00.326995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3559e-9f5a-44c2-9efe-35dbc328e451 service glance] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:00.340701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:00.342394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:00.342688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:00.342979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] PATH_INFO: `/v3/users/ab7f402bc6f74e81ad3a2c0e88d3f6cd` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:00.359121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7f402bc6f74e81ad3a2c0e88d3f6cd)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:00.359121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:00.360088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:00.388348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86406-0a4e-4eb7-ab5e-4e32740a6f0b service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:00.404692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:00.404692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:00.404692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:00.404692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:00.405043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:00.419432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7f402bc6f74e81ad3a2c0e88d3f6cd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:00.421132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7f402bc6f74e81ad3a2c0e88d3f6cd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:00.436149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7f402bc6f74e81ad3a2c0e88d3f6cd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:00.452487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7f402bc6f74e81ad3a2c0e88d3f6cd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:00.453690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b2a61170-41d7-4c6d-b6a5-efc1fab30750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7f402bc6f74e81ad3a2c0e88d3f6cd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:00.472512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 847/1686] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:00 2022] DELETE /identity/v3/users/ab7f402bc6f74e81ad3a2c0e88d3f6cd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:00.479057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:00.479656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:00.479656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:00.502453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:00.503729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:00.516131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:00.517761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:00.528969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 840/1687] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:25:00.570107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:00.581705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 848/1688] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:00.592072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:00.593683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:00.666091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e0df8-99ca-40b5-a4ef-746286389e2c service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:00.717992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:00.718602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:00.718877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:00.719186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:00.728405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:00.729868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:00.739379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 841/1689] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:01.040427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:01.042666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:01.055898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112085ed-c2d6-4c65-ab3d-13ebd528a4ae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:01.061566 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:01.062206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.062509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.062762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] PATH_INFO: `/v3/projects/81f056ed8e1544218d11dddcd27e1c98` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:01.063988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f056ed8e1544218d11dddcd27e1c98)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:01.065900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:01.115125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f056ed8e1544218d11dddcd27e1c98', 'request_id': 'req-a299e15d-6cdc-4787-baef-8d5eecb21a23'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.121937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f056ed8e1544218d11dddcd27e1c98', 'request_id': 'req-a299e15d-6cdc-4787-baef-8d5eecb21a23'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.127630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f056ed8e1544218d11dddcd27e1c98', 'request_id': 'req-a299e15d-6cdc-4787-baef-8d5eecb21a23'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.141545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] The token cache is being invalidate because project 81f056ed8e1544218d11dddcd27e1c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:01.141832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.142449 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.143967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 849/1690] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:01 2022] DELETE /identity/v3/projects/81f056ed8e1544218d11dddcd27e1c98 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:01.148210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:01.157918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccddb13-3f51-4bd8-bb81-a42c14386875 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:01.209293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:01.219221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:01.219881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.220163 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.220465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] PATH_INFO: `/v3/users/cbc1b841074d47b19507c98e75a439f6` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:01.221583 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc1b841074d47b19507c98e75a439f6)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:01.223555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:01.273473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc1b841074d47b19507c98e75a439f6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.274147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc1b841074d47b19507c98e75a439f6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.281674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc1b841074d47b19507c98e75a439f6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.291983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc1b841074d47b19507c98e75a439f6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.308979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:01.310607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:01.311424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-752e8ed8-07c5-4e61-926d-006b1082f270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc1b841074d47b19507c98e75a439f6'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.317866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 842/1691] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:01 2022] DELETE /identity/v3/users/cbc1b841074d47b19507c98e75a439f6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:01.327968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299e15d-6cdc-4787-baef-8d5eecb21a23 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:01.394690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:01.395422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.395710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.395986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] PATH_INFO: `/v3/users/345f0979c22d484d93880d841ae416cf` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:01.397169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345f0979c22d484d93880d841ae416cf)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:01.399236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:01.465364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345f0979c22d484d93880d841ae416cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.466067 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345f0979c22d484d93880d841ae416cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.473705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345f0979c22d484d93880d841ae416cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.487988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345f0979c22d484d93880d841ae416cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.488767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345f0979c22d484d93880d841ae416cf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.498571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:01.504410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 850/1692] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:01 2022] DELETE /identity/v3/users/345f0979c22d484d93880d841ae416cf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:01.508960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.509564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.509733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:01.532571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:01.534337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:01.614409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 843/1693] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:01.638795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:01.640652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:01.711876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:01.713639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:01.743187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bef94b-d2fa-4c32-85ec-7554f47e524f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:01.749490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:01.750151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.750472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.750748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] PATH_INFO: `/v3/projects/c4e2db7024644f42a00454af0878e74a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:01.752115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e2db7024644f42a00454af0878e74a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:01.754191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:01.758771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff51f9-b33c-4723-8615-bf2fb7cb0e20 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:01.770985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb04b7-5a0a-44f8-ba9d-a6e64a21d09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:01.772407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb04b7-5a0a-44f8-ba9d-a6e64a21d09b service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.773025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb04b7-5a0a-44f8-ba9d-a6e64a21d09b service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.773457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb04b7-5a0a-44f8-ba9d-a6e64a21d09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:01.785631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb04b7-5a0a-44f8-ba9d-a6e64a21d09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:01.787439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb04b7-5a0a-44f8-ba9d-a6e64a21d09b service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:01.808453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 851/1694] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:01.821281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e2db7024644f42a00454af0878e74a', 'request_id': 'req-229222dd-3715-421a-a8c1-fdf593ebaf76'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.829458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e2db7024644f42a00454af0878e74a', 'request_id': 'req-229222dd-3715-421a-a8c1-fdf593ebaf76'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.839395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e2db7024644f42a00454af0878e74a', 'request_id': 'req-229222dd-3715-421a-a8c1-fdf593ebaf76'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.844906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:01.858232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] The token cache is being invalidate because project c4e2db7024644f42a00454af0878e74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:01.865372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.866404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-229222dd-3715-421a-a8c1-fdf593ebaf76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:01.874116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a6da0-9acc-4d04-b0b8-804d054c4f25 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.874744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a6da0-9acc-4d04-b0b8-804d054c4f25 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.874871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a6da0-9acc-4d04-b0b8-804d054c4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:01.877847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 844/1695] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:01 2022] DELETE /identity/v3/projects/c4e2db7024644f42a00454af0878e74a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:01.899010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c00a6da0-9acc-4d04-b0b8-804d054c4f25 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:01.900805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c00a6da0-9acc-4d04-b0b8-804d054c4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:01.983394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 852/1696] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:01.991253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c87c-72de-4fc8-b109-31b92b1260ce None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:01.991547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c87c-72de-4fc8-b109-31b92b1260ce None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:01.991831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c87c-72de-4fc8-b109-31b92b1260ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.042120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0a05c87c-72de-4fc8-b109-31b92b1260ce None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:02.048389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0a05c87c-72de-4fc8-b109-31b92b1260ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:02.094063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 845/1697] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:02.097894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a6da0-9acc-4d04-b0b8-804d054c4f25 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.109626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a6da0-9acc-4d04-b0b8-804d054c4f25 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.118077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.119055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.119393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.119706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.120295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:02.120674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.122354 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.159888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 853/1698] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:25:02.164075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c87c-72de-4fc8-b109-31b92b1260ce None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.176154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c87c-72de-4fc8-b109-31b92b1260ce None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.188854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.189637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.189923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.190141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.190955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.194662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.238691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 846/1699] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:02.251937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.270209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0026b-434d-44c6-8810-95ff123dbbb8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.300786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.302636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:02.339824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.339824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.339824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.339824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.340992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.340992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.361084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 854/1700] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:02 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:02.364855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.374518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09093cc-2217-4ad6-8b47-70340dc4a00c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.379284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.379883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.380168 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.380444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.381084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.382702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.394427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 855/1701] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:25:02.398230 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.405419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7a5bd-6aa7-4d8b-a2d3-381cce5aa42f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.408556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf0dc-786b-4505-ad5c-284c34698d12 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.409911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.410539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.410816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.411111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] PATH_INFO: `/v3/projects/7d1451e237af48a1b2064f972c857fa5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.412233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1451e237af48a1b2064f972c857fa5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.413263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.413847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.414128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.414225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.414401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.415031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.416677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.418781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:02.429065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 856/1702] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:25:02.433450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.442972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051415ef-3851-4a2a-aa2a-47c3169623b9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.449251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c961d0-8b47-44e9-b2e3-a0a00176c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.450123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c961d0-8b47-44e9-b2e3-a0a00176c924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.450433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c961d0-8b47-44e9-b2e3-a0a00176c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.450781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c961d0-8b47-44e9-b2e3-a0a00176c924 admin admin] PATH_INFO: `/v3/projects/85a7a77d1cf6460082baae86a53eb474/users/c1153ab05c9248d5a8dfadc669f58b20/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.467388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c961d0-8b47-44e9-b2e3-a0a00176c924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a7a77d1cf6460082baae86a53eb474, user_id=c1153ab05c9248d5a8dfadc669f58b20, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.468425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1451e237af48a1b2064f972c857fa5', 'request_id': 'req-246768ff-9a90-458a-9d2e-5e86800e6861'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.470027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c961d0-8b47-44e9-b2e3-a0a00176c924 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.475135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1451e237af48a1b2064f972c857fa5', 'request_id': 'req-246768ff-9a90-458a-9d2e-5e86800e6861'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.482755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1451e237af48a1b2064f972c857fa5', 'request_id': 'req-246768ff-9a90-458a-9d2e-5e86800e6861'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.485035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 857/1703] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:02 2022] PUT /identity/v3/projects/85a7a77d1cf6460082baae86a53eb474/users/c1153ab05c9248d5a8dfadc669f58b20/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:02.493572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] The token cache is being invalidate because project 7d1451e237af48a1b2064f972c857fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:02.493861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.494854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.496545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.496676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 847/1704] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:02 2022] DELETE /identity/v3/projects/7d1451e237af48a1b2064f972c857fa5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:02.496763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.496949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.500546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.502181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:02.528298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] MFA Rules not processed for user `c1153ab05c9248d5a8dfadc669f58b20`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:02.529605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:02.565231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:02.570943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246768ff-9a90-458a-9d2e-5e86800e6861 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.604703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 858/1705] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:02.609206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.610589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:02.640212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.640872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.641155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.641529 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] PATH_INFO: `/v3/users/fce1181db77c4e04b9a4af87f84cd8c3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.642568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce1181db77c4e04b9a4af87f84cd8c3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.644675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.678323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49515559-a116-4bd9-b0a4-5892220a5781 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.683878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.684487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.684774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.685051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.685695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.687645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.691818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce1181db77c4e04b9a4af87f84cd8c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.692715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce1181db77c4e04b9a4af87f84cd8c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.710707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce1181db77c4e04b9a4af87f84cd8c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.720844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce1181db77c4e04b9a4af87f84cd8c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.729179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 859/1706] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:02 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:25:02.732858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.758052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce1181db77c4e04b9a4af87f84cd8c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:02.776301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 848/1707] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:02 2022] DELETE /identity/v3/users/fce1181db77c4e04b9a4af87f84cd8c3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:02.840824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:02.864529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ef305-f0c5-4a29-a1ee-5135fee3537f admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:02.936680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:02.937362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:02.937552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:02.937798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:02.939096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:02.943845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:02.973086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 860/1708] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:02 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:02.980431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:02.984928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:03.004530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97ca0-2ed8-47c9-b91e-02bd08f0c497 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.013334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.014207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.015121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.015121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.015496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.017206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.031283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 849/1709] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:03.033215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.044758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a079-5567-4e5d-99c2-e58f563622da admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.050358 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c082-08e8-46d8-a156-9ab957b2d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.051110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c082-08e8-46d8-a156-9ab957b2d210 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.051677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c082-08e8-46d8-a156-9ab957b2d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.052089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c082-08e8-46d8-a156-9ab957b2d210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.052879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83c082-08e8-46d8-a156-9ab957b2d210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.054614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83c082-08e8-46d8-a156-9ab957b2d210 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.066975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 861/1710] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:03.071594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.083685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2159dc-7cbd-42de-972f-def059bfa1c0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.089336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.090146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.090508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.092001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] PATH_INFO: `/v3/projects/8a4b87a7dc64477882e19cf4b055e03d/users/a937a1ed552347e88f808055f1f00715/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.114422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4b87a7dc64477882e19cf4b055e03d, user_id=a937a1ed552347e88f808055f1f00715, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.117534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.135559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 850/1711] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:03 2022] PUT /identity/v3/projects/8a4b87a7dc64477882e19cf4b055e03d/users/a937a1ed552347e88f808055f1f00715/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:03.146439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18674b3-7a2f-440c-b83b-08f2deaeb7f5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.146889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18674b3-7a2f-440c-b83b-08f2deaeb7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.147377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18674b3-7a2f-440c-b83b-08f2deaeb7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.214710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a18674b3-7a2f-440c-b83b-08f2deaeb7f5 None None] MFA Rules not processed for user `a937a1ed552347e88f808055f1f00715`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:03.216053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a18674b3-7a2f-440c-b83b-08f2deaeb7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:03.331319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 862/1712] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:03.334301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.444275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:03.465227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a5e31-0b10-489d-8a5e-2a3757438eac admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.474845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.476159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.476449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.476753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.478451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.480997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.523173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 851/1713] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:03 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:03.525438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18674b3-7a2f-440c-b83b-08f2deaeb7f5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.538313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18674b3-7a2f-440c-b83b-08f2deaeb7f5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.635021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.642279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.643309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.643741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.644588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.667318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.681782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:03.705156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 863/1714] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:03 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:03.707406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.732075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8610be-6eb6-467f-a4b1-64238cba8ada admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.744124 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.744706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.744981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.745316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.745974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.747628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.765887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 852/1715] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:03.767649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.780651 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560821cb-72a6-4079-866f-ae13f1529ddd admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.789403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.790750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.791214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.791703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] PATH_INFO: `/v3/projects/ca3c962f3cd54683983c595acabf475c/users/c2e0b349cbdf433cbe2b956767d44ffb/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.808862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.818726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:03.828141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3c962f3cd54683983c595acabf475c, user_id=c2e0b349cbdf433cbe2b956767d44ffb, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.832478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.835803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f1ff-3c22-40da-a8b8-9bab7a723397 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.853724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:03.856122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.856661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.857119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] PATH_INFO: `/v3/projects/5e5499977cc1484889f3af4ee2643546` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.859665 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5499977cc1484889f3af4ee2643546)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:03.861623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 864/1716] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:03 2022] PUT /identity/v3/projects/ca3c962f3cd54683983c595acabf475c/users/c2e0b349cbdf433cbe2b956767d44ffb/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:03.863922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:03.865552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:03.927777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5499977cc1484889f3af4ee2643546', 'request_id': 'req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:03.936735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5499977cc1484889f3af4ee2643546', 'request_id': 'req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:03.946176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5499977cc1484889f3af4ee2643546', 'request_id': 'req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:03.959225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] The token cache is being invalidate because project 5e5499977cc1484889f3af4ee2643546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:03.959443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:03.960117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9c483e8f-5ca1-4f98-b5e7-d14d0cafbcf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:03.961640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b496523-31ca-4ee9-869a-f32a180aa369 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:03.963336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 853/1717] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:03 2022] DELETE /identity/v3/projects/5e5499977cc1484889f3af4ee2643546 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:03.969165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736def-c463-497f-b52d-254518e59bd4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:03.969449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736def-c463-497f-b52d-254518e59bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:03.969723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c736def-c463-497f-b52d-254518e59bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:03.991779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2c736def-c463-497f-b52d-254518e59bd4 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:03.993597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2c736def-c463-497f-b52d-254518e59bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:04.044725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.045628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.045888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.046160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.046874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.048650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.065988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 865/1718] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:04.067699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.069013 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:04.083157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b09a-10fe-4ae7-845a-373eb4509af5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.083688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 854/1719] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:04.092235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d622-2ed8-4aca-b4b2-913b8d220027 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.092235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d622-2ed8-4aca-b4b2-913b8d220027 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.092502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d622-2ed8-4aca-b4b2-913b8d220027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.093095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb20aa-1cfd-4c0f-a4f5-98122557db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.093858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb20aa-1cfd-4c0f-a4f5-98122557db06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.094305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb20aa-1cfd-4c0f-a4f5-98122557db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.094567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb20aa-1cfd-4c0f-a4f5-98122557db06 admin admin] PATH_INFO: `/v3/projects/ca3c962f3cd54683983c595acabf475c/users/c2e0b349cbdf433cbe2b956767d44ffb/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.096849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb20aa-1cfd-4c0f-a4f5-98122557db06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3c962f3cd54683983c595acabf475c, user_id=c2e0b349cbdf433cbe2b956767d44ffb, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.099616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb20aa-1cfd-4c0f-a4f5-98122557db06 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.113340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-43a3d622-2ed8-4aca-b4b2-913b8d220027 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:04.114114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 866/1720] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:04 2022] PUT /identity/v3/projects/ca3c962f3cd54683983c595acabf475c/users/c2e0b349cbdf433cbe2b956767d44ffb/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:04.115255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-43a3d622-2ed8-4aca-b4b2-913b8d220027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:04.124914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.125386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.125672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.162415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] MFA Rules not processed for user `c2e0b349cbdf433cbe2b956767d44ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:04.164476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:04.187180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:04.211581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 855/1721] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:04.215930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d622-2ed8-4aca-b4b2-913b8d220027 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.229373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d622-2ed8-4aca-b4b2-913b8d220027 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.241292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.242587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.244397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.244862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.245729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:04.246247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.248696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.256632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:04.269932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 856/1722] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:25:04.275545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.295790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03b3e-b949-4bfb-974b-ac866e2926f1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.301686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.304512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.305041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.305512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.307172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.310068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.345265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 867/1723] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:04.352257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.355455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:04.396050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 857/1724] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:04 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:25:04.397565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.493906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af023fa6-cd48-4de7-9c51-fd3f3949a954 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.571418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793acdd-5f61-4b35-8222-c1994e269fb5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.606074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.608382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.609919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.610318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.613240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.618999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.625375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.627016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.629676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.631490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.671067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 858/1725] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:04 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:25:04.675310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.702937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36793f6c-2b79-4f78-991d-ac692224235c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.715373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.716687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.716973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.717419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.718101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.720719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.761463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.766439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.766613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 859/1726] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:04.770733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.798907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 868/1727] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:25:04.802104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7710d90-482b-4da7-a631-9cd6ef11ab9c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.809185 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.810010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.810451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.810942 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.811828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.813725 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.830274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 860/1728] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:04.835273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.855536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.859370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd63a5-1179-45e2-a0d2-e5db7d292350 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.860946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:04.877209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.880045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.880369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.880767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] PATH_INFO: `/v3/projects/65cac27944a741bf84afe8b552ac9d8b/users/72e3361f06f64f4b89c3f63974b1baa8/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.892692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a312877-af40-4b25-9a07-3ec6acfba557 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:04.907986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:04.909456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:04.909842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:04.910201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] PATH_INFO: `/v3/users/a1f310a4138c4b24a80f01c3319b6bbd` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:04.911978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f310a4138c4b24a80f01c3319b6bbd)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.913586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.922470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cac27944a741bf84afe8b552ac9d8b, user_id=72e3361f06f64f4b89c3f63974b1baa8, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:04.926300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:04.952020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 869/1729] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:04 2022] PUT /identity/v3/projects/65cac27944a741bf84afe8b552ac9d8b/users/72e3361f06f64f4b89c3f63974b1baa8/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:04.953234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:04.962791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:05.006607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f310a4138c4b24a80f01c3319b6bbd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:05.007430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f310a4138c4b24a80f01c3319b6bbd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:05.018235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f310a4138c4b24a80f01c3319b6bbd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:05.020499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:05.029418 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f310a4138c4b24a80f01c3319b6bbd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:05.038877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:05.047739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1a30df54-52b0-471c-81c8-19076a0bd51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f310a4138c4b24a80f01c3319b6bbd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:05.059062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 861/1730] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:04 2022] DELETE /identity/v3/users/a1f310a4138c4b24a80f01c3319b6bbd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:05.061980 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f6b-4f3e-4205-a222-e70087ba97ff None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:05.061980 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f6b-4f3e-4205-a222-e70087ba97ff None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:05.061980 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f6b-4f3e-4205-a222-e70087ba97ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:05.072834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06761-8790-449b-8f3a-a5300a94ea6c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:05.099206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-74435f6b-4f3e-4205-a222-e70087ba97ff None None] MFA Rules not processed for user `72e3361f06f64f4b89c3f63974b1baa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:05.101445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-74435f6b-4f3e-4205-a222-e70087ba97ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:05.144992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:05.145616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:05.145899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:05.146172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:05.148378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:05.189668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 862/1731] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:05.189668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:05.189668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:05.189668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:05.207165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:05.208509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:05.232340 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:05.237223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:05.253467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 870/1732] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:05.254401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:05.256415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:05.283970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffb333-cec7-4b91-9964-aaad336f02b9 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:05.288321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:05.288986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:05.289264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:05.289535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:05.307152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:05.307152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:05.323381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 863/1733] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:05.324350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 871/1734] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:05.341538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:05.346865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:05.422759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3488e1-537b-470e-a5cb-b78ccc7daf70 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:05.427651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:05.428487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:05.428924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:05.429386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:05.442874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:05.445220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:05.467411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 864/1735] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:06.050709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:06.053900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:06.101366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a65392-bf35-43d6-bba3-a3618efc0ddd service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:06.111409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:06.113553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:06.117301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:06.117685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] PATH_INFO: `/v3/projects/9e2d5ce0c9724d85b164b45a6de72f23` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:06.119648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2d5ce0c9724d85b164b45a6de72f23)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:06.122831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:06.226767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2d5ce0c9724d85b164b45a6de72f23', 'request_id': 'req-857e74bd-46d8-41e0-8473-ce9cb1119a0a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.234684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2d5ce0c9724d85b164b45a6de72f23', 'request_id': 'req-857e74bd-46d8-41e0-8473-ce9cb1119a0a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.245401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2d5ce0c9724d85b164b45a6de72f23', 'request_id': 'req-857e74bd-46d8-41e0-8473-ce9cb1119a0a'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.267373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] The token cache is being invalidate because project 9e2d5ce0c9724d85b164b45a6de72f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:06.269083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.270288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.272844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 872/1736] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:06 2022] DELETE /identity/v3/projects/9e2d5ce0c9724d85b164b45a6de72f23 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:06.277541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:06.288138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d35d1-cbe1-489b-9a8a-dd6f6cb89934 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:06.313100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:06.419059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:06.422336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:06.422809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:06.423485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] PATH_INFO: `/v3/users/f58d70fde13141e19198e6c222006d6c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:06.425338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58d70fde13141e19198e6c222006d6c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:06.439358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:06.556500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58d70fde13141e19198e6c222006d6c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.557842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58d70fde13141e19198e6c222006d6c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.577990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58d70fde13141e19198e6c222006d6c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.606206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58d70fde13141e19198e6c222006d6c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.644736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58d70fde13141e19198e6c222006d6c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:06.658101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 865/1737] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:06 2022] DELETE /identity/v3/users/f58d70fde13141e19198e6c222006d6c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:08.190246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:08.194926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:08.214013 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e74bd-46d8-41e0-8473-ce9cb1119a0a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:08.221684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:08.306441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:08.307403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:08.307685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:08.307958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] PATH_INFO: `/v3/projects/3b49e6163e89464ea5b9b7c6e6f6972f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:08.309205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b49e6163e89464ea5b9b7c6e6f6972f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:08.311311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:08.367906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b49e6163e89464ea5b9b7c6e6f6972f', 'request_id': 'req-f675c3a4-a975-4a41-9182-3da8cfb311ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.376609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b49e6163e89464ea5b9b7c6e6f6972f', 'request_id': 'req-f675c3a4-a975-4a41-9182-3da8cfb311ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.384415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b49e6163e89464ea5b9b7c6e6f6972f', 'request_id': 'req-f675c3a4-a975-4a41-9182-3da8cfb311ba'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.402544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] The token cache is being invalidate because project 3b49e6163e89464ea5b9b7c6e6f6972f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:08.402831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.403496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.405339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 873/1738] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:08 2022] DELETE /identity/v3/projects/3b49e6163e89464ea5b9b7c6e6f6972f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:08.409353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:08.412176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:08.428474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16144f26-aa51-4d1e-978c-31b74da03029 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:08.530449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:08.531905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:08.532290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:08.532555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] PATH_INFO: `/v3/users/05b6e5aae4f8448a8e2c15669450a751` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:08.534100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b6e5aae4f8448a8e2c15669450a751)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:08.536262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:08.590649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:08.593608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b6e5aae4f8448a8e2c15669450a751'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.594593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b6e5aae4f8448a8e2c15669450a751'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.603800 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b6e5aae4f8448a8e2c15669450a751'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.613001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b6e5aae4f8448a8e2c15669450a751'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.628272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b6e5aae4f8448a8e2c15669450a751'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:08.635443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 866/1739] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:08 2022] DELETE /identity/v3/users/05b6e5aae4f8448a8e2c15669450a751 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:09.155665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:09.158441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:09.179397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675c3a4-a975-4a41-9182-3da8cfb311ba admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:09.218082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:09.219549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:09.308776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eadb55-b502-4ca0-b89a-e3899655a70c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:09.314252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:09.314956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.315281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.315559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] PATH_INFO: `/v3/projects/7c0363d17fd2486984a16c7c56269d8b` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.316603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:09.317102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0363d17fd2486984a16c7c56269d8b)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:09.318262 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.318615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.319046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] PATH_INFO: `/v3/users/c1153ab05c9248d5a8dfadc669f58b20` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.319313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:09.321103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1153ab05c9248d5a8dfadc669f58b20)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:09.326364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:09.379173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0363d17fd2486984a16c7c56269d8b', 'request_id': 'req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.388593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0363d17fd2486984a16c7c56269d8b', 'request_id': 'req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.404385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:09.404575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0363d17fd2486984a16c7c56269d8b', 'request_id': 'req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.417382 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1153ab05c9248d5a8dfadc669f58b20'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.419211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1153ab05c9248d5a8dfadc669f58b20'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.430289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1153ab05c9248d5a8dfadc669f58b20'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.437806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] The token cache is being invalidate because project 7c0363d17fd2486984a16c7c56269d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:09.438359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.439000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4cc5d007-c1b2-4644-9ea0-f13774dc09e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.445535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 867/1740] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:09 2022] DELETE /identity/v3/projects/7c0363d17fd2486984a16c7c56269d8b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:09.448263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32dcd-c56e-4e96-8daf-30e71bdd84cd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.448552 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32dcd-c56e-4e96-8daf-30e71bdd84cd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.448828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32dcd-c56e-4e96-8daf-30e71bdd84cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.456884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1153ab05c9248d5a8dfadc669f58b20'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.462840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bd2513d0-4deb-4186-b313-847fa9191945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1153ab05c9248d5a8dfadc669f58b20'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:09.474663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-01e32dcd-c56e-4e96-8daf-30e71bdd84cd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:09.475990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-01e32dcd-c56e-4e96-8daf-30e71bdd84cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:09.489933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 874/1741] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:09 2022] DELETE /identity/v3/users/c1153ab05c9248d5a8dfadc669f58b20 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:09.495436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e45a-d759-4f0e-b261-3c5837ea0be9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.496006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e45a-d759-4f0e-b261-3c5837ea0be9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.496468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970e45a-d759-4f0e-b261-3c5837ea0be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.536222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:09.539541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0970e45a-d759-4f0e-b261-3c5837ea0be9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:09.545043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0970e45a-d759-4f0e-b261-3c5837ea0be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:09.579065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 868/1742] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:09.580590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72873db-9e72-4b6c-8006-0d39943e7ac0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.580889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72873db-9e72-4b6c-8006-0d39943e7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.581599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72873db-9e72-4b6c-8006-0d39943e7ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.627769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a72873db-9e72-4b6c-8006-0d39943e7ac0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:09.633705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a72873db-9e72-4b6c-8006-0d39943e7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:09.680362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 875/1743] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:09.717668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 869/1744] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:09.722147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970e45a-d759-4f0e-b261-3c5837ea0be9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:09.733090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970e45a-d759-4f0e-b261-3c5837ea0be9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:09.738802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:09.739582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.739865 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.740138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.740968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:09.741284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:09.742938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:09.761356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 876/1745] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:25:09.762899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72873db-9e72-4b6c-8006-0d39943e7ac0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:09.775619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72873db-9e72-4b6c-8006-0d39943e7ac0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:09.781224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:09.782065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.782350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.782723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.783713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:09.786562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:09.831123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 870/1746] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:09 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:09.833244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:09.845228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5d2da-c1df-4a04-aaf6-8a02bbda96d7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:09.930830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:09.931520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:09.932068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:09.932347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:09.933002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:09.935521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:09.981573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 877/1747] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:09 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:09.985825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:09.997688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ca6d-2c0f-434d-bf62-1163c9af26cf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:10.002807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:10.003878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:10.004170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:10.004445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:10.005117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:10.006987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:10.020150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 871/1748] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:10.024289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:10.035505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b89203-fc64-463f-89be-3c52d6ec26eb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:10.043514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:10.044238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:10.045051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:10.045051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:10.045621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:10.047387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:10.061699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 878/1749] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:10.065906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:10.068279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:10.072052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:10.084607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7777c-205e-4ed8-a886-4544d3a121e8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:10.094662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2dd67-45bc-4d7e-b038-c66699865aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:10.095837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2dd67-45bc-4d7e-b038-c66699865aae admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:10.096123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2dd67-45bc-4d7e-b038-c66699865aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:10.096438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2dd67-45bc-4d7e-b038-c66699865aae admin admin] PATH_INFO: `/v3/projects/f37c50f6bd644ebdbe642d0929baaf1e/users/a99c7d427b62475b87a5a32ecb4ad9c9/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:10.116141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:10.117138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2dd67-45bc-4d7e-b038-c66699865aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37c50f6bd644ebdbe642d0929baaf1e, user_id=a99c7d427b62475b87a5a32ecb4ad9c9, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:10.120666 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2dd67-45bc-4d7e-b038-c66699865aae admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:10.141779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 872/1750] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:10 2022] PUT /identity/v3/projects/f37c50f6bd644ebdbe642d0929baaf1e/users/a99c7d427b62475b87a5a32ecb4ad9c9/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:10.153484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:10.154340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:10.154805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:10.163279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661b7a8-49db-4ead-a0c0-9dda77b83068 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:10.200361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] MFA Rules not processed for user `a99c7d427b62475b87a5a32ecb4ad9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:10.201735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:10.235760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:10.236600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:10.236815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:10.237101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:10.299513 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 873/1751] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:10.311977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:10.313895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:10.367049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:10.411419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:10.414274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:10.419908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd768f-8911-4196-b2fd-75a89602d973 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:10.425317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:10.426331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:10.426683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:10.427031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:10.436864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 879/1752] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:10.439738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:10.442092 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:10.464396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 874/1753] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:11.047118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:11.049275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:11.074427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599cf9-e504-4dd3-acee-fa59ee7ca90b service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:11.080615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:11.081386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:11.081766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:11.082150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] PATH_INFO: `/v3/projects/85a7a77d1cf6460082baae86a53eb474` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:11.083467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a7a77d1cf6460082baae86a53eb474)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:11.086268 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:11.154986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a7a77d1cf6460082baae86a53eb474', 'request_id': 'req-8fc26160-a5c5-4d23-808c-75dfe989f189'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.174292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a7a77d1cf6460082baae86a53eb474', 'request_id': 'req-8fc26160-a5c5-4d23-808c-75dfe989f189'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.191193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a7a77d1cf6460082baae86a53eb474', 'request_id': 'req-8fc26160-a5c5-4d23-808c-75dfe989f189'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.213825 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] The token cache is being invalidate because project 85a7a77d1cf6460082baae86a53eb474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:11.214220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.214986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.231250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 880/1754] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:11 2022] DELETE /identity/v3/projects/85a7a77d1cf6460082baae86a53eb474 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:11.236443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:11.257526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cce81-340b-4d08-a70d-bbf61533cb74 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:11.416189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:11.417033 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:11.417388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:11.417740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] PATH_INFO: `/v3/users/a937a1ed552347e88f808055f1f00715` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:11.419148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a937a1ed552347e88f808055f1f00715)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:11.421524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:11.530454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a937a1ed552347e88f808055f1f00715'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.531336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a937a1ed552347e88f808055f1f00715'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.545044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a937a1ed552347e88f808055f1f00715'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.574372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a937a1ed552347e88f808055f1f00715'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.593052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a937a1ed552347e88f808055f1f00715'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:11.600606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 875/1755] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:11 2022] DELETE /identity/v3/users/a937a1ed552347e88f808055f1f00715 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:12.218566 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:12.220755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:12.236468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc26160-a5c5-4d23-808c-75dfe989f189 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:12.248151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:12.317327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:12.317972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:12.318249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:12.318520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] PATH_INFO: `/v3/projects/8a4b87a7dc64477882e19cf4b055e03d` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:12.319665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4b87a7dc64477882e19cf4b055e03d)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:12.322342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:12.369617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4b87a7dc64477882e19cf4b055e03d', 'request_id': 'req-8752d6dc-d3dd-4375-9b46-fc234790df46'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.376017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4b87a7dc64477882e19cf4b055e03d', 'request_id': 'req-8752d6dc-d3dd-4375-9b46-fc234790df46'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.381609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4b87a7dc64477882e19cf4b055e03d', 'request_id': 'req-8752d6dc-d3dd-4375-9b46-fc234790df46'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.395478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] The token cache is being invalidate because project 8a4b87a7dc64477882e19cf4b055e03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:12.395869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.396508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.399554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 881/1756] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:12 2022] DELETE /identity/v3/projects/8a4b87a7dc64477882e19cf4b055e03d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:12.404546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:12.406108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:12.419973 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2284-a036-45bb-8cd2-2e8dc77e9e43 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:12.487041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:12.505819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:12.506317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:12.506598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:12.506878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] PATH_INFO: `/v3/users/c2e0b349cbdf433cbe2b956767d44ffb` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:12.508256 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e0b349cbdf433cbe2b956767d44ffb)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:12.511838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:12.588258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e0b349cbdf433cbe2b956767d44ffb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.589720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e0b349cbdf433cbe2b956767d44ffb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.600746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e0b349cbdf433cbe2b956767d44ffb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.613614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e0b349cbdf433cbe2b956767d44ffb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.634578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e0b349cbdf433cbe2b956767d44ffb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:12.647496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 876/1757] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:12 2022] DELETE /identity/v3/users/c2e0b349cbdf433cbe2b956767d44ffb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:13.120817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:13.122286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:13.140489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752d6dc-d3dd-4375-9b46-fc234790df46 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:13.254188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:13.256323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.258093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.258987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] PATH_INFO: `/v3/projects/ca3c962f3cd54683983c595acabf475c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.260665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3c962f3cd54683983c595acabf475c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:13.263411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:13.309380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:13.312985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:13.332379 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:13.334489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ccf5-5782-44d9-99b4-a8884c45847a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:13.339306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3c962f3cd54683983c595acabf475c', 'request_id': 'req-7578ad12-bc91-497b-9f49-41fe959a60d8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.349959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3c962f3cd54683983c595acabf475c', 'request_id': 'req-7578ad12-bc91-497b-9f49-41fe959a60d8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.360476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3c962f3cd54683983c595acabf475c', 'request_id': 'req-7578ad12-bc91-497b-9f49-41fe959a60d8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.380229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] The token cache is being invalidate because project ca3c962f3cd54683983c595acabf475c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:13.381402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.382240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7578ad12-bc91-497b-9f49-41fe959a60d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.389613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 882/1758] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:13 2022] DELETE /identity/v3/projects/ca3c962f3cd54683983c595acabf475c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:13.391903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210389cc-3c3c-4e9e-bf76-02ce359d0acd None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.392201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210389cc-3c3c-4e9e-bf76-02ce359d0acd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.392831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210389cc-3c3c-4e9e-bf76-02ce359d0acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.439563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-210389cc-3c3c-4e9e-bf76-02ce359d0acd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:13.442152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-210389cc-3c3c-4e9e-bf76-02ce359d0acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:13.448614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:13.449287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.449579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.449857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] PATH_INFO: `/v3/users/a99c7d427b62475b87a5a32ecb4ad9c9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.451118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99c7d427b62475b87a5a32ecb4ad9c9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:13.453509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:13.456422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 883/1759] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:13.465978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b009d0-91f8-4e61-aca0-bb0c14d8434f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.466654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b009d0-91f8-4e61-aca0-bb0c14d8434f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.467277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b009d0-91f8-4e61-aca0-bb0c14d8434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.509917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-77b009d0-91f8-4e61-aca0-bb0c14d8434f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:13.514516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-77b009d0-91f8-4e61-aca0-bb0c14d8434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:13.527272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99c7d427b62475b87a5a32ecb4ad9c9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.527943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99c7d427b62475b87a5a32ecb4ad9c9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.532521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 884/1760] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:13.533904 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b009d0-91f8-4e61-aca0-bb0c14d8434f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:13.542068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99c7d427b62475b87a5a32ecb4ad9c9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.554707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b009d0-91f8-4e61-aca0-bb0c14d8434f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:13.559058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99c7d427b62475b87a5a32ecb4ad9c9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.567900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:13.574945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:13.577270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.577560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.577840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.578511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:13.578815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:13.580468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:13.591366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f3d0549-e13d-4274-801d-4e45d44f9cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99c7d427b62475b87a5a32ecb4ad9c9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:13.599155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 877/1761] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:13 2022] DELETE /identity/v3/users/a99c7d427b62475b87a5a32ecb4ad9c9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:13.605879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.606403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.606881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.619130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 885/1762] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:25:13.624116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:13.630847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:13.632960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:13.634699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:13.652019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d67d6-7a3c-469b-a429-1277a72dbaa5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:13.732277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 878/1763] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:13.741812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:13.744311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:13.778871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:13.779531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.779812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.780086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.780721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:13.782726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:13.828297 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 886/1764] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:13 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:13.829345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:13.832853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13b939-b6a2-4419-9c50-13369308c2bd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:13.911038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c584fb5-72a4-4c6a-9394-6c4975977d21 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:13.914586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:13.915733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.916142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.916421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.919155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0c839-c4ed-427b-9826-122da65f91f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:13.920130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c839-c4ed-427b-9826-122da65f91f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.920490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c839-c4ed-427b-9826-122da65f91f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.920836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c839-c4ed-427b-9826-122da65f91f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.921812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c839-c4ed-427b-9826-122da65f91f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:13.924582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c839-c4ed-427b-9826-122da65f91f9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:13.926769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:13.929010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:13.954711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 887/1765] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:13 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:13.956631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 879/1766] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:25:13.959535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:13.975190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100a49-ba19-4f96-a246-906f14b17a7f None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.975525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100a49-ba19-4f96-a246-906f14b17a7f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.975946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04100a49-ba19-4f96-a246-906f14b17a7f None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.978064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 888/1767] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:25:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:25:13.982082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea88bbf-2fdb-44c0-8b4c-e28d2587e38f service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:13.992591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:13.992906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:13.993791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:13.994066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:13.998459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.001283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.011413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243b123-1d76-4529-a238-2eb65ff7a7b5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.012076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243b123-1d76-4529-a238-2eb65ff7a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.014511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243b123-1d76-4529-a238-2eb65ff7a7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.050388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4243b123-1d76-4529-a238-2eb65ff7a7b5 None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:14.051129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 880/1768] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:14.052778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.055228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4243b123-1d76-4529-a238-2eb65ff7a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.104872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:14.108275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064a78-dcd0-473f-ba68-ef2cc7a30d38 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.123002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.124364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.125681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.125965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.127184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.133307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.166049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 881/1769] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:14.167137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.172207 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.197565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92a8a-cb9b-415d-954c-747b11cbbfef admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.219679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.220470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.220757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.221344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] PATH_INFO: `/v3/users/5d55946aecd64ff88095e59d6ec03c0e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.222951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d55946aecd64ff88095e59d6ec03c0e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.224928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.231724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 889/1770] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:14.232890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243b123-1d76-4529-a238-2eb65ff7a7b5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.250648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:14.264075 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243b123-1d76-4529-a238-2eb65ff7a7b5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.279702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafab28-8717-4d3b-af8d-5a2c86779699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.280641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafab28-8717-4d3b-af8d-5a2c86779699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.281135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafab28-8717-4d3b-af8d-5a2c86779699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.281641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafab28-8717-4d3b-af8d-5a2c86779699 admin admin] PATH_INFO: `/v3/projects/b637e8d5ab6647a191b534536425d02e/users/68a43e09d0544ad1a5d02accfa8d7c39/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.310606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d55946aecd64ff88095e59d6ec03c0e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.312693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d55946aecd64ff88095e59d6ec03c0e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.324809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d55946aecd64ff88095e59d6ec03c0e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.325867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafab28-8717-4d3b-af8d-5a2c86779699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b637e8d5ab6647a191b534536425d02e, user_id=68a43e09d0544ad1a5d02accfa8d7c39, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.329519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafab28-8717-4d3b-af8d-5a2c86779699 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.333325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d55946aecd64ff88095e59d6ec03c0e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.353460 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-11cd77b9-afe3-40ae-ac96-f1a7e2cc178c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d55946aecd64ff88095e59d6ec03c0e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.366718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 882/1771] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:14 2022] DELETE /identity/v3/users/5d55946aecd64ff88095e59d6ec03c0e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:14.368146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eb6c3-a8f2-4c8d-ae9e-8a88500f51ed None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.368938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eb6c3-a8f2-4c8d-ae9e-8a88500f51ed None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.369215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eb6c3-a8f2-4c8d-ae9e-8a88500f51ed None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.370535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 883/1772] 10.222.0.46 () {54 vars in 961 bytes} [Wed Oct 19 13:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:25:14.372609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 890/1773] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:14 2022] PUT /identity/v3/projects/b637e8d5ab6647a191b534536425d02e/users/68a43e09d0544ad1a5d02accfa8d7c39/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:14.376465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.376755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.377027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.385353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.385353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.385586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.424903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:14.426147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.442482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] MFA Rules not processed for user `68a43e09d0544ad1a5d02accfa8d7c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:14.443968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.536801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 891/1774] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:14.546376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 884/1775] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Oct 19 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:14.547071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.547607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.548692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.549176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.632077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796f45-413c-445c-a2eb-a2658172f349 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.638768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.640503 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.641514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.641907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.642663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.645550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.651840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49be85-6640-4249-9cde-6abdd6379491 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.656914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.657770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.658060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.658335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] PATH_INFO: `/v3/projects/f37c50f6bd644ebdbe642d0929baaf1e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.660781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37c50f6bd644ebdbe642d0929baaf1e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.663045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.689501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 892/1776] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:14 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:14.690369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.702745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:14.723209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:14.741212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37c50f6bd644ebdbe642d0929baaf1e', 'request_id': 'req-96ebdd48-1c61-4036-a734-47af4858e62b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.750307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37c50f6bd644ebdbe642d0929baaf1e', 'request_id': 'req-96ebdd48-1c61-4036-a734-47af4858e62b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.760448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37c50f6bd644ebdbe642d0929baaf1e', 'request_id': 'req-96ebdd48-1c61-4036-a734-47af4858e62b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.773856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] The token cache is being invalidate because project f37c50f6bd644ebdbe642d0929baaf1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:14.774134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.774950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:14.779174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 885/1777] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:14 2022] DELETE /identity/v3/projects/f37c50f6bd644ebdbe642d0929baaf1e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:14.779174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.779400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.783653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e80883-4093-415b-abd4-1e9f0341ab98 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.896329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.897135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.897517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.897924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.900125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.903752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebdd48-1c61-4036-a734-47af4858e62b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.909630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.910332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.910671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.911156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.912063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.914430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.916428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.918102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.929093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 893/1778] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:14.930243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.932850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:14.942015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 886/1779] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:14 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:14.946199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.951937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3165fe-16db-4bba-9924-16950d2aa6ae service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.958402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.959238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.959568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90059060-b901-4dc3-9362-a75addba4ac4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:14.959767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.960109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] PATH_INFO: `/v3/projects/2972ad91b2d8447cb07c4ab34a1881dd` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.961860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2972ad91b2d8447cb07c4ab34a1881dd)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.964623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.965682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:14.966368 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:14.966690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:14.967111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:14.968743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:14.970490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:14.987199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 887/1780] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:25:14.988209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:14.999048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0394d-e3c3-422e-aeed-326aaf692fa6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.004264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.004921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.005203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.005480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] PATH_INFO: `/v3/projects/44b6d243d0c841ff9b2fde4480348fef/users/5d555052d0f8493c8441ebc6d57862fd/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.017480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2972ad91b2d8447cb07c4ab34a1881dd', 'request_id': 'req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:15.020110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b6d243d0c841ff9b2fde4480348fef, user_id=5d555052d0f8493c8441ebc6d57862fd, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.023321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.024131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2972ad91b2d8447cb07c4ab34a1881dd', 'request_id': 'req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:15.030745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2972ad91b2d8447cb07c4ab34a1881dd', 'request_id': 'req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:15.036497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 888/1781] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:14 2022] PUT /identity/v3/projects/44b6d243d0c841ff9b2fde4480348fef/users/5d555052d0f8493c8441ebc6d57862fd/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:15.041183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.043939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] The token cache is being invalidate because project 2972ad91b2d8447cb07c4ab34a1881dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:15.044231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:15.044857 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1c5a27a6-f320-4cb3-aff8-329510c9f0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:15.046354 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 894/1782] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:14 2022] DELETE /identity/v3/projects/2972ad91b2d8447cb07c4ab34a1881dd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:15.051051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c3ba-4361-4222-bc58-2755f342dfbd None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.051352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c3ba-4361-4222-bc58-2755f342dfbd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.051626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c3ba-4361-4222-bc58-2755f342dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.073243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5b97c3ba-4361-4222-bc58-2755f342dfbd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:15.074478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5b97c3ba-4361-4222-bc58-2755f342dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.093376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:15.110337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d552b-8fc8-45b9-a0b9-e694d7bc6200 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.116414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.117028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.117309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.117582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.118826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.120511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.130788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 889/1783] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:25:15.134846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.136671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.142976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 895/1784] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:15.149277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541602b-9406-4a45-9484-338c50ca0766 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.150665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064a460-82c1-40d5-9ef0-b23ff5ddce33 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.151023 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064a460-82c1-40d5-9ef0-b23ff5ddce33 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.151336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064a460-82c1-40d5-9ef0-b23ff5ddce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.153853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd6c80-0e53-4bf9-a7e2-0639bd25979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.154572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd6c80-0e53-4bf9-a7e2-0639bd25979f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.154924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd6c80-0e53-4bf9-a7e2-0639bd25979f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.155274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd6c80-0e53-4bf9-a7e2-0639bd25979f admin admin] PATH_INFO: `/v3/projects/44b6d243d0c841ff9b2fde4480348fef/users/5d555052d0f8493c8441ebc6d57862fd/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.157192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd6c80-0e53-4bf9-a7e2-0639bd25979f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b6d243d0c841ff9b2fde4480348fef, user_id=5d555052d0f8493c8441ebc6d57862fd, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.159885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd6c80-0e53-4bf9-a7e2-0639bd25979f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.165961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:15.171413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c064a460-82c1-40d5-9ef0-b23ff5ddce33 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:15.172771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c064a460-82c1-40d5-9ef0-b23ff5ddce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.177091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 890/1785] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:15 2022] PUT /identity/v3/projects/44b6d243d0c841ff9b2fde4480348fef/users/5d555052d0f8493c8441ebc6d57862fd/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:15.189440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.189440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.189637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.219051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] MFA Rules not processed for user `5d555052d0f8493c8441ebc6d57862fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:15.220372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.238772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 896/1786] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:15.242930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064a460-82c1-40d5-9ef0-b23ff5ddce33 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.252668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064a460-82c1-40d5-9ef0-b23ff5ddce33 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.257439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.258100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.258408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.258711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.259386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:15.259695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.261369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.273460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 897/1787] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:25:15.277652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.287218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47bfc2-9cf8-48bf-97a6-644f285325ac admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.291408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 891/1788] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:15.292435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.293028 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.293312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.293589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.294219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.296207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.302645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.304019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.327595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 898/1789] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:15 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:15.328697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.367753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e747fa-dec2-41a2-888d-4b31a64da5bd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.394500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f22049-ea54-4567-9ed6-1fab273ff2ad admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.401394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.402006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.402314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.402671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.403334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.405344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.427748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2ae05-16f3-447d-88b7-ba522f4ba74f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.428987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2ae05-16f3-447d-88b7-ba522f4ba74f service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.429276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2ae05-16f3-447d-88b7-ba522f4ba74f service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.429549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2ae05-16f3-447d-88b7-ba522f4ba74f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.431242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 899/1790] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:15 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:15.431582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6ea2ae05-16f3-447d-88b7-ba522f4ba74f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.434360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.446885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588c10c-875a-4063-86fd-f6b898264362 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.451833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.452513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.452983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.453360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.454242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.456005 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.471181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 900/1791] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:15.474366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.486474 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9185b-7470-4bd0-a05a-f2b80dd9d509 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.491642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.492515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.492898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.493373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.494149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.495972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.499863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:15.504229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:15.505843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2ae05-16f3-447d-88b7-ba522f4ba74f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.508043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2ae05-16f3-447d-88b7-ba522f4ba74f service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.519248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 901/1792] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:25:15.521643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.522611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 892/1793] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:25:15.533312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870774-2297-4ba2-b670-5edbb94f10c7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.538954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.540451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.540847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.541225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] PATH_INFO: `/v3/projects/a2a3d48917b04965801f83f3ee9f9259/users/815494a41aaa400c99841f38ffd50c63/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.562505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a3d48917b04965801f83f3ee9f9259, user_id=815494a41aaa400c99841f38ffd50c63, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.565526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.585489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 902/1794] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:15 2022] PUT /identity/v3/projects/a2a3d48917b04965801f83f3ee9f9259/users/815494a41aaa400c99841f38ffd50c63/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:15.592126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb1a97-0d5e-4810-bc58-8d35547d540a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.592597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb1a97-0d5e-4810-bc58-8d35547d540a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.592937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb1a97-0d5e-4810-bc58-8d35547d540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.621710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-bfdb1a97-0d5e-4810-bc58-8d35547d540a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:15.622981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bfdb1a97-0d5e-4810-bc58-8d35547d540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.710685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 893/1795] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:15.722321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:15.724372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:15.798890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a4c9-8a12-4113-885d-f5d6441fd078 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:15.802713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa9767-1390-410f-874e-48b83c9e1236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:15.803353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9767-1390-410f-874e-48b83c9e1236 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:15.803631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9767-1390-410f-874e-48b83c9e1236 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:15.803903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9767-1390-410f-874e-48b83c9e1236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:15.814025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa9767-1390-410f-874e-48b83c9e1236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:15.815492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa9767-1390-410f-874e-48b83c9e1236 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:15.827169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 903/1796] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:18.208905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb1a97-0d5e-4810-bc58-8d35547d540a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:18.223135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb1a97-0d5e-4810-bc58-8d35547d540a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:18.228247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:18.228985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:18.229341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:18.229826 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] PATH_INFO: `/v3/users/68a43e09d0544ad1a5d02accfa8d7c39` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:18.231790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a43e09d0544ad1a5d02accfa8d7c39)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:18.234283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:18.293630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a43e09d0544ad1a5d02accfa8d7c39'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:18.294711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a43e09d0544ad1a5d02accfa8d7c39'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:18.307415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a43e09d0544ad1a5d02accfa8d7c39'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:18.320155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a43e09d0544ad1a5d02accfa8d7c39'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:18.335862 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a43e09d0544ad1a5d02accfa8d7c39'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:18.349537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 894/1797] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:18 2022] DELETE /identity/v3/users/68a43e09d0544ad1a5d02accfa8d7c39 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:18.351213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:18.351690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:18.351814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:18.376332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:18.377727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:18.460138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 904/1798] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:18.474177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:18.475669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:18.567996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8691b3-3daa-4eb9-8fb5-21adbd9606d2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:18.574131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:18.574832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:18.575292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:18.575630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:18.588212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:18.593918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:18.617301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 895/1799] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:18.980575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:18.982016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:18.995334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd2efe-bc79-46ff-961a-e1f0502b8264 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:19.000355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:19.001235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:19.001850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:19.001850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] PATH_INFO: `/v3/projects/b637e8d5ab6647a191b534536425d02e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:19.003166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b637e8d5ab6647a191b534536425d02e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:19.005323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:19.060673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b637e8d5ab6647a191b534536425d02e', 'request_id': 'req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.069242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b637e8d5ab6647a191b534536425d02e', 'request_id': 'req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.078602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b637e8d5ab6647a191b534536425d02e', 'request_id': 'req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.091500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:19.101572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] The token cache is being invalidate because project b637e8d5ab6647a191b534536425d02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:19.101980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.105871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.109351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 905/1800] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:18 2022] DELETE /identity/v3/projects/b637e8d5ab6647a191b534536425d02e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:19.115164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:19.129771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f80301-aa37-4589-81ee-4ec67384e964 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:19.140424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:19.247479 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:19.248789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:19.249254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:19.249715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] PATH_INFO: `/v3/users/5d555052d0f8493c8441ebc6d57862fd` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:19.251273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d555052d0f8493c8441ebc6d57862fd)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:19.253516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:19.307976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:19.313303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:19.341829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0bcf-54ba-4d8c-ab46-86794b0d02af admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:19.347715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:19.348634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:19.349068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:19.349456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] PATH_INFO: `/v3/users/72e3361f06f64f4b89c3f63974b1baa8` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:19.350777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e3361f06f64f4b89c3f63974b1baa8)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:19.350977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d555052d0f8493c8441ebc6d57862fd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.351926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d555052d0f8493c8441ebc6d57862fd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.354260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:19.362782 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d555052d0f8493c8441ebc6d57862fd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.376597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d555052d0f8493c8441ebc6d57862fd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.394744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a8f6b2dc-f60f-4c48-8219-1a094d837a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d555052d0f8493c8441ebc6d57862fd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.404328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 896/1801] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:19 2022] DELETE /identity/v3/users/5d555052d0f8493c8441ebc6d57862fd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:19.433364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e3361f06f64f4b89c3f63974b1baa8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.434264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e3361f06f64f4b89c3f63974b1baa8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.444176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e3361f06f64f4b89c3f63974b1baa8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.465412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e3361f06f64f4b89c3f63974b1baa8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.466303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e3361f06f64f4b89c3f63974b1baa8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:19.484614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 906/1802] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:19 2022] DELETE /identity/v3/users/72e3361f06f64f4b89c3f63974b1baa8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:19.488961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:19.489276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:19.489556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:19.509974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:19.511253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:19.595118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 897/1803] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:19.609167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:19.611922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:19.717373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4156e-9964-4fa4-a2de-0afd97bdfa36 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:19.721900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf819d7-e216-4df1-a74c-bc48a23d6343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:19.722715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf819d7-e216-4df1-a74c-bc48a23d6343 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:19.723831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf819d7-e216-4df1-a74c-bc48a23d6343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:19.724118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf819d7-e216-4df1-a74c-bc48a23d6343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:19.735590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf819d7-e216-4df1-a74c-bc48a23d6343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:19.737257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf819d7-e216-4df1-a74c-bc48a23d6343 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:19.753217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 907/1804] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:19.933013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:19.935402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:19.955640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1bb8-bad9-4367-9685-85e57e27dc73 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:19.966481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:19.966481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:19.966481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:19.966481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] PATH_INFO: `/v3/projects/44b6d243d0c841ff9b2fde4480348fef` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:19.968246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b6d243d0c841ff9b2fde4480348fef)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:19.970658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:20.020894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:20.060794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b6d243d0c841ff9b2fde4480348fef', 'request_id': 'req-75878bed-68c7-46d3-9f79-b495532844f0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.068963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b6d243d0c841ff9b2fde4480348fef', 'request_id': 'req-75878bed-68c7-46d3-9f79-b495532844f0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.079842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b6d243d0c841ff9b2fde4480348fef', 'request_id': 'req-75878bed-68c7-46d3-9f79-b495532844f0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.094005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] The token cache is being invalidate because project 44b6d243d0c841ff9b2fde4480348fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:20.094452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.095326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-75878bed-68c7-46d3-9f79-b495532844f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.099165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 898/1805] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:19 2022] DELETE /identity/v3/projects/44b6d243d0c841ff9b2fde4480348fef => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:20.102360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e347d-67ae-43a6-84df-75940ccd150f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.102666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e347d-67ae-43a6-84df-75940ccd150f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.103155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e347d-67ae-43a6-84df-75940ccd150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:20.127021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-257e347d-67ae-43a6-84df-75940ccd150f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:20.128661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-257e347d-67ae-43a6-84df-75940ccd150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:20.246885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ae775-b317-4306-8216-755b0253df10 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.247478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ae775-b317-4306-8216-755b0253df10 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.247592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ae775-b317-4306-8216-755b0253df10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:20.251459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 908/1806] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:20.290284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0f3ae775-b317-4306-8216-755b0253df10 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:20.293049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0f3ae775-b317-4306-8216-755b0253df10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:20.307340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 899/1807] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:20.312405 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e347d-67ae-43a6-84df-75940ccd150f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:20.330828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e347d-67ae-43a6-84df-75940ccd150f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:20.336968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:20.337642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.338051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.338396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:20.339423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:20.339706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:20.342779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:20.366485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:20.377359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 909/1808] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:25:20.381896 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ae775-b317-4306-8216-755b0253df10 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:20.400288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ae775-b317-4306-8216-755b0253df10 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:20.420087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:20.420738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.421021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.421296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:20.421952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:20.426275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:20.495000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 900/1809] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:20 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:20.498494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:20.511531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:20.516848 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209279d-b140-4039-9725-6e4598b82f11 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:20.519623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:20.663673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd964fd-63a9-4706-aa8f-e6921f82615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:20.664328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd964fd-63a9-4706-aa8f-e6921f82615c admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.664613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd964fd-63a9-4706-aa8f-e6921f82615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.665433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd964fd-63a9-4706-aa8f-e6921f82615c admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:20.666100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd964fd-63a9-4706-aa8f-e6921f82615c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:20.671614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd964fd-63a9-4706-aa8f-e6921f82615c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:20.722935 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbe89b-c260-45f3-9131-a1ba00da9565 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:20.735883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:20.736419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 910/1810] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:20 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:20.737596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.738293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.738848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] PATH_INFO: `/v3/projects/65cac27944a741bf84afe8b552ac9d8b` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:20.739842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1f23-600e-4afc-ab24-8b4de9eb3d20 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.740733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cac27944a741bf84afe8b552ac9d8b)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:20.740895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1f23-600e-4afc-ab24-8b4de9eb3d20 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.741166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1f23-600e-4afc-ab24-8b4de9eb3d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:20.743635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:20.821845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0c2e1f23-600e-4afc-ab24-8b4de9eb3d20 None None] MFA Rules not processed for user `815494a41aaa400c99841f38ffd50c63`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:20.823176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0c2e1f23-600e-4afc-ab24-8b4de9eb3d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:20.831764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cac27944a741bf84afe8b552ac9d8b', 'request_id': 'req-b53e814d-8355-4b1e-b846-215d5a159994'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.847482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cac27944a741bf84afe8b552ac9d8b', 'request_id': 'req-b53e814d-8355-4b1e-b846-215d5a159994'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.866568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cac27944a741bf84afe8b552ac9d8b', 'request_id': 'req-b53e814d-8355-4b1e-b846-215d5a159994'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.916943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] The token cache is being invalidate because project 65cac27944a741bf84afe8b552ac9d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:20.917393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.920341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:20.925170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 901/1811] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:20 2022] DELETE /identity/v3/projects/65cac27944a741bf84afe8b552ac9d8b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:20.925780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:20.928871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:20.962475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:20.991877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 911/1812] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:20.997511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2844-df02-4e77-8552-51e1c43e0d45 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:20.997511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2844-df02-4e77-8552-51e1c43e0d45 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:20.997511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2844-df02-4e77-8552-51e1c43e0d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.027615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-903d2844-df02-4e77-8552-51e1c43e0d45 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:21.030129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-903d2844-df02-4e77-8552-51e1c43e0d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.052608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e814d-8355-4b1e-b846-215d5a159994 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.059952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.060777 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.061470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.062685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.063405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.065333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.079313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 902/1813] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:21.080446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.083813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.101618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 912/1814] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:21.102471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2844-df02-4e77-8552-51e1c43e0d45 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.117949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2844-df02-4e77-8552-51e1c43e0d45 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.125364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9062b6-5c7b-4738-ba66-6658d1b8667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.126083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9062b6-5c7b-4738-ba66-6658d1b8667b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.126428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9062b6-5c7b-4738-ba66-6658d1b8667b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.126768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9062b6-5c7b-4738-ba66-6658d1b8667b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.127534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9062b6-5c7b-4738-ba66-6658d1b8667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.129423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9062b6-5c7b-4738-ba66-6658d1b8667b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.141080 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 913/1815] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:21.144990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc408b5c-f67b-4bd7-a395-55749b802e38 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.145436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc408b5c-f67b-4bd7-a395-55749b802e38 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.145765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc408b5c-f67b-4bd7-a395-55749b802e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.169981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-cc408b5c-f67b-4bd7-a395-55749b802e38 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:21.171647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-cc408b5c-f67b-4bd7-a395-55749b802e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.183573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceea0c0-9d40-49a7-90c7-11e739d0b537 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.184096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 914/1816] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:21.185260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc408b5c-f67b-4bd7-a395-55749b802e38 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.190284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.191050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:21.191191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.191871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.191871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.197745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc408b5c-f67b-4bd7-a395-55749b802e38 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.202729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.204456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.205274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.205950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.206229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.206503 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] PATH_INFO: `/v3/projects/0a89af7289d34f5ebf92531326d8e9c1/users/7678dd1a3f2c44a08af803d2e95a1d62/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.214717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 903/1817] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:21.215597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.224742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a89af7289d34f5ebf92531326d8e9c1, user_id=7678dd1a3f2c44a08af803d2e95a1d62, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.225911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aea120-758e-4b4d-a000-001415df3483 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.227649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.231291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.232322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.234254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.234555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.235215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:21.235512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.237300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.250839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 904/1818] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:25:21.255255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.264465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 915/1819] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:21 2022] PUT /identity/v3/projects/0a89af7289d34f5ebf92531326d8e9c1/users/7678dd1a3f2c44a08af803d2e95a1d62/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:21.271263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.273195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.277677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f10c3e-3d9a-4585-bfa5-a364d4f32247 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.357225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cafb1d-e089-43e5-9006-c552c1dfb740 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.362501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.363315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.363664 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.364007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] PATH_INFO: `/v3/users/8423bfc7ccda47579c70727ae5cd6c06` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.365375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8423bfc7ccda47579c70727ae5cd6c06)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.366924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17356f3d-b3d6-4ff3-ac1d-c0535325b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.367700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.369115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356f3d-b3d6-4ff3-ac1d-c0535325b9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.369919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356f3d-b3d6-4ff3-ac1d-c0535325b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.370373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17356f3d-b3d6-4ff3-ac1d-c0535325b9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.371363 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356f3d-b3d6-4ff3-ac1d-c0535325b9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.375379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17356f3d-b3d6-4ff3-ac1d-c0535325b9f1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.419184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 905/1820] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:21 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:21.419184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b3d69-3cad-4dbd-8424-98513f894784 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.419184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b3d69-3cad-4dbd-8424-98513f894784 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.419184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b3d69-3cad-4dbd-8424-98513f894784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.438129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:21.457585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8423bfc7ccda47579c70727ae5cd6c06'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:21.458301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8423bfc7ccda47579c70727ae5cd6c06'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:21.467314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8423bfc7ccda47579c70727ae5cd6c06'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:21.476077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ea0b3d69-3cad-4dbd-8424-98513f894784 None None] MFA Rules not processed for user `7678dd1a3f2c44a08af803d2e95a1d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:21.477486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ea0b3d69-3cad-4dbd-8424-98513f894784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.486019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8423bfc7ccda47579c70727ae5cd6c06'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:21.487102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8423bfc7ccda47579c70727ae5cd6c06'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:21.513808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 916/1821] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:21 2022] DELETE /identity/v3/users/8423bfc7ccda47579c70727ae5cd6c06 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:21.515097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.516980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.596765 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 906/1822] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:21.603386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.605048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.605401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.626807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:21.628354 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:21.629745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.634959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9f202-63ba-4a54-af15-e2c73d4886e0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.641726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 907/1823] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:21.642615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.646937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.647385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.648699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.650483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.650841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.651706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.654841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.692665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 917/1824] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:21 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:21.695095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.696919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:21.728282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75b30-99f1-4e93-94aa-067ec035022f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.732762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.733395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.733675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.733951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.772587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800da8fd-d6ad-4894-8afb-3ad4eddde073 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.776325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.776953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.777289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.777505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.790345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.791970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.808756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 918/1825] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:21.809187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.820708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1d356-c9e9-419b-826b-14393263d2b9 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.825894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.826516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.826799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.827140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.827630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.827887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.829308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.829526 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.840356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 908/1826] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:21.845089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 919/1827] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:21.846738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.862863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1a82-fbea-456b-a425-33f222c47682 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.869340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cdfb9-3e56-4aa0-bf4c-7ee05f95cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.870191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdfb9-3e56-4aa0-bf4c-7ee05f95cd62 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.870483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdfb9-3e56-4aa0-bf4c-7ee05f95cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.870883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdfb9-3e56-4aa0-bf4c-7ee05f95cd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.871787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cdfb9-3e56-4aa0-bf4c-7ee05f95cd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.873580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cdfb9-3e56-4aa0-bf4c-7ee05f95cd62 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.890047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:21.901293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 909/1828] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:21.901491 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958035d-d636-4329-85b7-9aa354aaee74 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:21.912001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:21.912735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.913015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.913483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] PATH_INFO: `/v3/projects/d7d5a8eff9944031b2db2d68d235c182/users/93d727d97e22448d830ec978202d8aae/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:21.952030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d5a8eff9944031b2db2d68d235c182, user_id=93d727d97e22448d830ec978202d8aae, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:21.954739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:21.983274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 920/1829] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:21 2022] PUT /identity/v3/projects/d7d5a8eff9944031b2db2d68d235c182/users/93d727d97e22448d830ec978202d8aae/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:25:21.990567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:21.990908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:21.992371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:22.042471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] MFA Rules not processed for user `93d727d97e22448d830ec978202d8aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:22.044043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:22.079007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:22.159572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 910/1830] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:22.171454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:22.178062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:22.302100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c4b6-31c4-4ae6-bb5e-9f877460be20 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:22.309016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ab43-d841-4a99-8321-27d943fe5e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:22.310710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ab43-d841-4a99-8321-27d943fe5e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:22.311537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ab43-d841-4a99-8321-27d943fe5e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:22.312201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ab43-d841-4a99-8321-27d943fe5e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:22.331008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ab43-d841-4a99-8321-27d943fe5e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:22.342190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:22.343889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:22.344279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ab43-d841-4a99-8321-27d943fe5e5e service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:22.361655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 921/1831] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:22.482166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496336b-1eac-4c7f-842a-e1f00fc9feaf None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:22.491061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:22.492751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:22.493215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:22.493909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] PATH_INFO: `/v3/projects/f9857f21c45f4a04bbf6ed293d8aa83c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:22.495289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9857f21c45f4a04bbf6ed293d8aa83c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:22.497688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:22.579578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9857f21c45f4a04bbf6ed293d8aa83c', 'request_id': 'req-f6986268-3be1-4716-bedc-289ab1cc39f1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:22.588477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9857f21c45f4a04bbf6ed293d8aa83c', 'request_id': 'req-f6986268-3be1-4716-bedc-289ab1cc39f1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:22.597245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9857f21c45f4a04bbf6ed293d8aa83c', 'request_id': 'req-f6986268-3be1-4716-bedc-289ab1cc39f1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:22.612718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] The token cache is being invalidate because project f9857f21c45f4a04bbf6ed293d8aa83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:22.613370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:22.614811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f6986268-3be1-4716-bedc-289ab1cc39f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:22.617260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 911/1832] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:22 2022] DELETE /identity/v3/projects/f9857f21c45f4a04bbf6ed293d8aa83c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:22.622353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2e94b-b325-48bb-b20b-c47cfd41d9e0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:22.622849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2e94b-b325-48bb-b20b-c47cfd41d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:22.622965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2e94b-b325-48bb-b20b-c47cfd41d9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:22.645088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f1f2e94b-b325-48bb-b20b-c47cfd41d9e0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:22.646493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f1f2e94b-b325-48bb-b20b-c47cfd41d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:22.722385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:22.735238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 922/1833] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:22.742943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0279-269b-42ae-8d3c-7152cc9963bc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:22.743231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0279-269b-42ae-8d3c-7152cc9963bc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:22.743509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0279-269b-42ae-8d3c-7152cc9963bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:22.795838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-529f0279-269b-42ae-8d3c-7152cc9963bc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:22.799417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-529f0279-269b-42ae-8d3c-7152cc9963bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:22.828560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 912/1834] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:22.844649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2e94b-b325-48bb-b20b-c47cfd41d9e0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:22.853289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2e94b-b325-48bb-b20b-c47cfd41d9e0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:22.861146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:22.862032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:22.862496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:22.862990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:22.863784 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:22.864186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:22.866189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:22.888218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 923/1835] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:25:22.892273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0279-269b-42ae-8d3c-7152cc9963bc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:22.903125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0279-269b-42ae-8d3c-7152cc9963bc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:22.908632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:22.909830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:22.910329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:22.910626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:22.911505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:22.914024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:22.949643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 913/1836] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:22 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:22.954143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:22.971257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd882-6985-482f-816b-838d6a3f7789 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:23.062197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:23.063623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.064605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.065031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:23.065840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:23.067929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:23.091724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 924/1837] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:22 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:23.095923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:23.108094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361215-4d64-4ed7-8dce-304e8107ca18 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:23.113220 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:23.113796 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.114079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.114350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:23.115023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:23.116688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:23.127911 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 914/1838] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:23.132435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:23.145785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda9a3b-15a4-4f68-89af-87a58779ede2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:23.152765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4241d5e-6c3b-4e00-befd-b89b4d9ce5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:23.154057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241d5e-6c3b-4e00-befd-b89b4d9ce5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.154577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241d5e-6c3b-4e00-befd-b89b4d9ce5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.155052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4241d5e-6c3b-4e00-befd-b89b4d9ce5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:23.155926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4241d5e-6c3b-4e00-befd-b89b4d9ce5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:23.158006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4241d5e-6c3b-4e00-befd-b89b4d9ce5f0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:23.174844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 925/1839] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:23.179306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:23.198206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fd1da-6193-4096-b519-46dd7351b9ac admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:23.204626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9aac5-1686-4524-8311-2226c3e76cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:23.205532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9aac5-1686-4524-8311-2226c3e76cae admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.205992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9aac5-1686-4524-8311-2226c3e76cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.206278 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9aac5-1686-4524-8311-2226c3e76cae admin admin] PATH_INFO: `/v3/projects/c8db5cbe8fbd4854a0e438c62375bfbf/users/7dc9c651aefa4d1c8c5311eca45005e3/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:23.220874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:23.225902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9aac5-1686-4524-8311-2226c3e76cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8db5cbe8fbd4854a0e438c62375bfbf, user_id=7dc9c651aefa4d1c8c5311eca45005e3, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:23.229462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9aac5-1686-4524-8311-2226c3e76cae admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:23.255146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 915/1840] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:23 2022] PUT /identity/v3/projects/c8db5cbe8fbd4854a0e438c62375bfbf/users/7dc9c651aefa4d1c8c5311eca45005e3/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:23.260487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.260772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.261048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:23.286047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:23.287935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:23.336363 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf310a5-7492-4e28-a1d3-8ab73f6c9ca5 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.337227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf310a5-7492-4e28-a1d3-8ab73f6c9ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.337502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf310a5-7492-4e28-a1d3-8ab73f6c9ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:23.360804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-aaf310a5-7492-4e28-a1d3-8ab73f6c9ca5 None None] MFA Rules not processed for user `815494a41aaa400c99841f38ffd50c63`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:23.362695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aaf310a5-7492-4e28-a1d3-8ab73f6c9ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:23.373735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 926/1841] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:23.383666 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:23.385207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:23.426200 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 916/1842] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:23.446094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba863d8a-9bb6-41a3-8a03-dea6607dc338 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:23.449769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32115ff8-8d7b-4fac-840c-f9d82820b928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:23.450620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115ff8-8d7b-4fac-840c-f9d82820b928 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.450707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115ff8-8d7b-4fac-840c-f9d82820b928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.450925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115ff8-8d7b-4fac-840c-f9d82820b928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:23.461101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32115ff8-8d7b-4fac-840c-f9d82820b928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:23.463129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32115ff8-8d7b-4fac-840c-f9d82820b928 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:23.475404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 927/1843] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:25:23.948531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:23.948881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:23.949114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:24.006739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] MFA Rules not processed for user `93d727d97e22448d830ec978202d8aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:24.008045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:24.150379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 917/1844] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:24.436205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:24.436765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:24.436765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:24.455047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:24.477096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] MFA Rules not processed for user `7dc9c651aefa4d1c8c5311eca45005e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:24.478287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:24.651428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 928/1845] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:24.661982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:24.665148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:24.817764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10d632-3000-4ebf-9381-51cb3ce37ea2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:24.825190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a6c1-5853-4f21-8737-e3f29406438d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:24.826943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a6c1-5853-4f21-8737-e3f29406438d service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:24.827335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a6c1-5853-4f21-8737-e3f29406438d service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:24.827910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a6c1-5853-4f21-8737-e3f29406438d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:24.846551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a6c1-5853-4f21-8737-e3f29406438d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:24.848833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a6c1-5853-4f21-8737-e3f29406438d service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:24.881236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 918/1846] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:25.636296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:25.637820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:25.653903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd1571-cdef-4f5c-8268-a55f8d73bbca None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:25.659858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:25.660512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:25.660793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:25.661063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] PATH_INFO: `/v3/users/7678dd1a3f2c44a08af803d2e95a1d62` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:25.667212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7678dd1a3f2c44a08af803d2e95a1d62)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:25.669282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:25.745018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7678dd1a3f2c44a08af803d2e95a1d62'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:25.745702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7678dd1a3f2c44a08af803d2e95a1d62'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:25.753827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7678dd1a3f2c44a08af803d2e95a1d62'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:25.767673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7678dd1a3f2c44a08af803d2e95a1d62'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:25.768675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7678dd1a3f2c44a08af803d2e95a1d62'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:25.784461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 929/1847] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:25 2022] DELETE /identity/v3/users/7678dd1a3f2c44a08af803d2e95a1d62 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:25.789187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:25.789739 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:25.789835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:25.814394 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:25.815729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:25.856819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:25.887904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 919/1848] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:25.893798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:25.895273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:25.966737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1672461-8fff-403d-a045-5ce87a2671f5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:25.970738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e3008-5814-4ddd-b52b-5a21e3f79a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:25.971476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3008-5814-4ddd-b52b-5a21e3f79a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:25.971768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3008-5814-4ddd-b52b-5a21e3f79a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:25.972042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3008-5814-4ddd-b52b-5a21e3f79a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:25.983017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e3008-5814-4ddd-b52b-5a21e3f79a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:25.984768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e3008-5814-4ddd-b52b-5a21e3f79a9a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:25.998473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 930/1849] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:25:26.350954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:26.352967 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:26.364807 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3859246-29c0-4bbc-94f3-f7bd27246983 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:26.370437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:26.371130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.371412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.371680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] PATH_INFO: `/v3/projects/0a89af7289d34f5ebf92531326d8e9c1` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.372799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a89af7289d34f5ebf92531326d8e9c1)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:26.374743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:26.423813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a89af7289d34f5ebf92531326d8e9c1', 'request_id': 'req-d980c839-13c2-49d8-ab88-c4938124c59b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:26.430913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a89af7289d34f5ebf92531326d8e9c1', 'request_id': 'req-d980c839-13c2-49d8-ab88-c4938124c59b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:26.440308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a89af7289d34f5ebf92531326d8e9c1', 'request_id': 'req-d980c839-13c2-49d8-ab88-c4938124c59b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:26.456545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750e45-f2eb-4634-a080-dc1e99059f61 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.456829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750e45-f2eb-4634-a080-dc1e99059f61 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.457101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750e45-f2eb-4634-a080-dc1e99059f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.465634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] The token cache is being invalidate because project 0a89af7289d34f5ebf92531326d8e9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:26.466045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:26.466944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d980c839-13c2-49d8-ab88-c4938124c59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:26.469014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 920/1850] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:26 2022] DELETE /identity/v3/projects/0a89af7289d34f5ebf92531326d8e9c1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:26.474694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e307a7-902c-49ac-892e-0ce7d25ad7a2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.474694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e307a7-902c-49ac-892e-0ce7d25ad7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.474694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e307a7-902c-49ac-892e-0ce7d25ad7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.482207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-51750e45-f2eb-4634-a080-dc1e99059f61 None None] MFA Rules not processed for user `7dc9c651aefa4d1c8c5311eca45005e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:26.484009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-51750e45-f2eb-4634-a080-dc1e99059f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:26.491175 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:26.500779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-41e307a7-902c-49ac-892e-0ce7d25ad7a2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:26.502446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-41e307a7-902c-49ac-892e-0ce7d25ad7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:26.571331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 931/1851] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:26.615136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 921/1852] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:26.623460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45b75b-dcd0-4220-9486-031a19fd8a08 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.623960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45b75b-dcd0-4220-9486-031a19fd8a08 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.624301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45b75b-dcd0-4220-9486-031a19fd8a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.653997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3a45b75b-dcd0-4220-9486-031a19fd8a08 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:26.655332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3a45b75b-dcd0-4220-9486-031a19fd8a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:26.669475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 932/1853] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:26.670863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e307a7-902c-49ac-892e-0ce7d25ad7a2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:26.688902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e307a7-902c-49ac-892e-0ce7d25ad7a2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:26.702423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:26.705188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.705482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.705757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.709086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:26.711881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:26.715060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:26.736301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 922/1854] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:25:26.740620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45b75b-dcd0-4220-9486-031a19fd8a08 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:26.752655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45b75b-dcd0-4220-9486-031a19fd8a08 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:26.760548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:26.761173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.762122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.762780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.763438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:26.766156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:26.812927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 933/1855] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:26 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:26.814105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:26.825480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ca47-aa12-42e1-b4dd-4cb0f20ee11d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:26.891647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:26.908875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:26.909592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.909997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.910735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.911751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:26.915683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:26.940821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 923/1856] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:26 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:25:26.945078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:26.959747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2f080-0282-409b-bd35-160d7cf89fa4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:26.965945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:26.966713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:26.967062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:26.967452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:26.968173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:26.969887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:26.985088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 934/1857] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:25:26.986253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:26.997840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfe878-7b25-4730-9476-fc5b87e3907f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:27.002898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1ea96-f27b-493c-81fd-75d739ef1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:27.003548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ea96-f27b-493c-81fd-75d739ef1fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:27.003828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ea96-f27b-493c-81fd-75d739ef1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:27.004100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ea96-f27b-493c-81fd-75d739ef1fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:27.004754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1ea96-f27b-493c-81fd-75d739ef1fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:27.006356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1ea96-f27b-493c-81fd-75d739ef1fd4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:27.019259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 924/1858] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:27.024700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:27.034720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15008e-7637-4131-b53f-05a54a4c6ac2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:27.040146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:27.040878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:27.041226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:27.041569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] PATH_INFO: `/v3/projects/90cf0bdcdfdd4df6954163b3eb0a018e/users/ac14a3ad80c8447281cff9e970cebf04/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:27.057918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cf0bdcdfdd4df6954163b3eb0a018e, user_id=ac14a3ad80c8447281cff9e970cebf04, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:27.060790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:27.074895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 935/1859] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:27 2022] PUT /identity/v3/projects/90cf0bdcdfdd4df6954163b3eb0a018e/users/ac14a3ad80c8447281cff9e970cebf04/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:27.085484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132388-2c81-4531-b71d-727e88ed6f3f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:27.085866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132388-2c81-4531-b71d-727e88ed6f3f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:27.086210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132388-2c81-4531-b71d-727e88ed6f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:27.118233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-16132388-2c81-4531-b71d-727e88ed6f3f None None] MFA Rules not processed for user `ac14a3ad80c8447281cff9e970cebf04`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:27.119590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-16132388-2c81-4531-b71d-727e88ed6f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:27.192429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 925/1860] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:27.204772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:27.206514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:27.268302 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa1ae-d3dc-404a-979d-cc0feee5f2a1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:27.272094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b729c38-fb31-4268-a17f-d4596383fe9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:27.272728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b729c38-fb31-4268-a17f-d4596383fe9f service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:27.273013 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b729c38-fb31-4268-a17f-d4596383fe9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:27.273290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b729c38-fb31-4268-a17f-d4596383fe9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:27.284753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b729c38-fb31-4268-a17f-d4596383fe9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:27.286226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b729c38-fb31-4268-a17f-d4596383fe9f service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:27.296758 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 936/1861] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:27.324929 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132388-2c81-4531-b71d-727e88ed6f3f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:27.397231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132388-2c81-4531-b71d-727e88ed6f3f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:27.403536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:27.404221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:27.404505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:27.404774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] PATH_INFO: `/v3/users/ac14a3ad80c8447281cff9e970cebf04` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:27.405949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac14a3ad80c8447281cff9e970cebf04)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:27.408989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:27.465910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac14a3ad80c8447281cff9e970cebf04'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:27.466635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac14a3ad80c8447281cff9e970cebf04'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:27.475416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac14a3ad80c8447281cff9e970cebf04'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:27.485183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac14a3ad80c8447281cff9e970cebf04'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:27.486771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:27.502416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac14a3ad80c8447281cff9e970cebf04'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:27.510421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 926/1862] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:27 2022] DELETE /identity/v3/users/ac14a3ad80c8447281cff9e970cebf04 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:27.514679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:27.515128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:27.516305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:27.536327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:27.537698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:27.594875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:27.607649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 937/1863] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:27.618412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:27.619907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:27.681276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f35d1-5dfc-457f-ab60-43758319270e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:27.685306 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c354215-0650-4db0-8e78-51ccee8e1d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:27.685949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c354215-0650-4db0-8e78-51ccee8e1d24 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:27.686231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c354215-0650-4db0-8e78-51ccee8e1d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:27.686502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c354215-0650-4db0-8e78-51ccee8e1d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:27.696064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c354215-0650-4db0-8e78-51ccee8e1d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:27.697422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c354215-0650-4db0-8e78-51ccee8e1d24 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:27.707890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 927/1864] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:28.041264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:28.043204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:28.073226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ad44-abe2-4030-9921-5d6af764a56e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:28.083424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:28.087862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:28.092084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:28.092541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] PATH_INFO: `/v3/projects/90cf0bdcdfdd4df6954163b3eb0a018e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:28.094311 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cf0bdcdfdd4df6954163b3eb0a018e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:28.098077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:28.167295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cf0bdcdfdd4df6954163b3eb0a018e', 'request_id': 'req-9fec475b-adc8-40fc-bc07-d914d1a2dccd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:28.188164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cf0bdcdfdd4df6954163b3eb0a018e', 'request_id': 'req-9fec475b-adc8-40fc-bc07-d914d1a2dccd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:28.194560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cf0bdcdfdd4df6954163b3eb0a018e', 'request_id': 'req-9fec475b-adc8-40fc-bc07-d914d1a2dccd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:28.212854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] The token cache is being invalidate because project 90cf0bdcdfdd4df6954163b3eb0a018e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:28.213787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:28.214082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-9fec475b-adc8-40fc-bc07-d914d1a2dccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:28.216010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 938/1865] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:28 2022] DELETE /identity/v3/projects/90cf0bdcdfdd4df6954163b3eb0a018e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:37.702954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=33,keystone:DELETE=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:38.208063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:52.459234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211acb28-b07c-44a5-989f-712844757d47 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:52.459688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211acb28-b07c-44a5-989f-712844757d47 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:52.459780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211acb28-b07c-44a5-989f-712844757d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:52.480029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-211acb28-b07c-44a5-989f-712844757d47 None None] MFA Rules not processed for user `7dc9c651aefa4d1c8c5311eca45005e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:52.481224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-211acb28-b07c-44a5-989f-712844757d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:52.539052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 928/1866] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:52.581401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce72f2-9a6e-4a92-8882-5f60ce72c762 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:52.581854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce72f2-9a6e-4a92-8882-5f60ce72c762 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:52.581975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce72f2-9a6e-4a92-8882-5f60ce72c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:52.602955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-67ce72f2-9a6e-4a92-8882-5f60ce72c762 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:52.604188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-67ce72f2-9a6e-4a92-8882-5f60ce72c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:52.659511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 939/1867] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:25:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:52.710255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211acb28-b07c-44a5-989f-712844757d47 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:52.711795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-211acb28-b07c-44a5-989f-712844757d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:52.781681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211acb28-b07c-44a5-989f-712844757d47 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:52.786661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:52.787310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:52.787587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:52.787860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:52.796595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:52.798244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:52.807246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 929/1868] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:25:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:25:53.380775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5506f-dee3-4fa3-b9af-12d10cc964f4 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:53.381245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5506f-dee3-4fa3-b9af-12d10cc964f4 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:53.381624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5506f-dee3-4fa3-b9af-12d10cc964f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:53.402471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1cc5506f-dee3-4fa3-b9af-12d10cc964f4 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:53.403731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1cc5506f-dee3-4fa3-b9af-12d10cc964f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:53.415345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 940/1869] 10.222.0.46 () {58 vars in 967 bytes} [Wed Oct 19 13:25:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:25:53.425650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:53.437167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411f07-aebe-4ee3-beb6-0484e02084e8 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:53.442733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:53.443449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:53.443690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:53.443962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:53.453039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:53.454622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:53.463567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 930/1870] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:25:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:25:53.743123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f646-9be3-4f72-a325-87b4dd64171a None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:53.743615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f646-9be3-4f72-a325-87b4dd64171a None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:53.743809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f646-9be3-4f72-a325-87b4dd64171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:53.764200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9780f646-9be3-4f72-a325-87b4dd64171a None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:53.765416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9780f646-9be3-4f72-a325-87b4dd64171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:53.773083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 941/1871] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:25:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:53.785081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:53.796372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe128f-ff31-476f-b34e-aeb04155313f service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:53.801650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:53.802278 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:53.802553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:53.802821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:53.812053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:53.813691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:53.822193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 931/1872] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:25:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:25:54.169063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:54.169348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:54.169649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:54.188762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:54.189947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:54.197455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 942/1873] 10.222.0.46 () {58 vars in 967 bytes} [Wed Oct 19 13:25:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:54.210164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:54.221716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b8585-005c-415d-b902-a21258ddfc78 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:54.227681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd3421-007e-468e-9a3a-a251e96f3bba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:54.228351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd3421-007e-468e-9a3a-a251e96f3bba service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:54.228700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd3421-007e-468e-9a3a-a251e96f3bba service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:54.229059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd3421-007e-468e-9a3a-a251e96f3bba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:54.237699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd3421-007e-468e-9a3a-a251e96f3bba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:54.239344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd3421-007e-468e-9a3a-a251e96f3bba service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:54.247966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 932/1874] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:25:56.439611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:56.441069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:56.508797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957711bb-c506-4f3f-b0d8-5cb237861b9d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:56.513522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:56.514144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:56.514426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:56.514698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] PATH_INFO: `/v3/users/93d727d97e22448d830ec978202d8aae` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:56.515874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d727d97e22448d830ec978202d8aae)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:56.517795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:56.571454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d727d97e22448d830ec978202d8aae'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:56.572100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d727d97e22448d830ec978202d8aae'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:56.579048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d727d97e22448d830ec978202d8aae'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:56.590600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d727d97e22448d830ec978202d8aae'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:56.591193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d727d97e22448d830ec978202d8aae'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:56.603477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 943/1875] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:25:56 2022] DELETE /identity/v3/users/93d727d97e22448d830ec978202d8aae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:56.607841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:56.608312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:56.608420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:56.628085 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:56.629270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:56.679723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:56.693115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 933/1876] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:56.703315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:56.704751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:56.711456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:56.765442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735c69b-cc88-4009-8084-9ea08bf9efbe admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:56.769307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151a793-b646-4a2d-8485-27e7d482a7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:56.769927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151a793-b646-4a2d-8485-27e7d482a7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:56.770211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151a793-b646-4a2d-8485-27e7d482a7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:56.770481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151a793-b646-4a2d-8485-27e7d482a7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:56.779722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151a793-b646-4a2d-8485-27e7d482a7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:56.781156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151a793-b646-4a2d-8485-27e7d482a7b4 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:56.790494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 944/1877] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:56.954156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:56.955621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:56.967755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84decc-c88f-4b9e-a82a-d798d9a01a73 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:56.972915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:56.973528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:56.973811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:56.974102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] PATH_INFO: `/v3/projects/d7d5a8eff9944031b2db2d68d235c182` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:56.975299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d5a8eff9944031b2db2d68d235c182)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:56.977840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.023444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d5a8eff9944031b2db2d68d235c182', 'request_id': 'req-99a52be3-b4e5-4e73-b900-38855aacbbef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:57.029945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d5a8eff9944031b2db2d68d235c182', 'request_id': 'req-99a52be3-b4e5-4e73-b900-38855aacbbef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:57.037338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d5a8eff9944031b2db2d68d235c182', 'request_id': 'req-99a52be3-b4e5-4e73-b900-38855aacbbef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:57.049137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] The token cache is being invalidate because project d7d5a8eff9944031b2db2d68d235c182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:25:57.049412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:57.050096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-99a52be3-b4e5-4e73-b900-38855aacbbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:25:57.051657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 934/1878] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:25:56 2022] DELETE /identity/v3/projects/d7d5a8eff9944031b2db2d68d235c182 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:57.057429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d1ad-e265-4c4d-a225-f5b39426c8b2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.057713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d1ad-e265-4c4d-a225-f5b39426c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.057982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d1ad-e265-4c4d-a225-f5b39426c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.077633 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-e3a3d1ad-e265-4c4d-a225-f5b39426c8b2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:57.078811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e3a3d1ad-e265-4c4d-a225-f5b39426c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:57.139660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 945/1879] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:57.148916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d9d8-2e62-404f-9d77-e192b5206fa1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.149202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d9d8-2e62-404f-9d77-e192b5206fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.149506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d9d8-2e62-404f-9d77-e192b5206fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.169888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c952d9d8-2e62-404f-9d77-e192b5206fa1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:57.171158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c952d9d8-2e62-404f-9d77-e192b5206fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:57.179397 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 935/1880] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:57.184199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d1ad-e265-4c4d-a225-f5b39426c8b2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:57.194539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d1ad-e265-4c4d-a225-f5b39426c8b2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:57.199980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:57.200618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.200914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.201185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.201829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:25:57.202127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:57.203779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.215913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 946/1881] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:25:57.220149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952d9d8-2e62-404f-9d77-e192b5206fa1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:57.229447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952d9d8-2e62-404f-9d77-e192b5206fa1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:57.234068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:57.234662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.234940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.235316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.235958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:57.237881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.264367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 936/1882] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:25:57 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:57.268443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:57.278936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba7358-ad61-4317-8dc8-978f27625a30 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:57.334187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:57.334793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.335071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.335489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.336116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:57.338053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.357953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 947/1883] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:25:57 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:25:57.362312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:57.373087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be502f-a1eb-46a7-a1bc-b360ef0721ff admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:57.377704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:57.378313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.378590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.378860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.379536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:57.381211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.391697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 937/1884] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:57.395741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:57.405631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab960-b09a-429a-b82e-c422059d6075 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:57.410202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27053bff-c459-45df-9325-7a2646701d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:57.410796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27053bff-c459-45df-9325-7a2646701d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.411094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27053bff-c459-45df-9325-7a2646701d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.411389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27053bff-c459-45df-9325-7a2646701d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.412029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27053bff-c459-45df-9325-7a2646701d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:57.413623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27053bff-c459-45df-9325-7a2646701d07 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.424830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 948/1885] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:25:57.430503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:57.441423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131258be-52c0-4daf-9c5d-87c32dda3a2c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:57.446570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:57.447244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.447523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.447795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] PATH_INFO: `/v3/projects/7062e651169f49e1a6dd2dd55b1f55f2/users/d949b76c01bf405cb8a12da29cf4227f/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.461982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7062e651169f49e1a6dd2dd55b1f55f2, user_id=d949b76c01bf405cb8a12da29cf4227f, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:57.464654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.477149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 938/1886] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:25:57 2022] PUT /identity/v3/projects/7062e651169f49e1a6dd2dd55b1f55f2/users/d949b76c01bf405cb8a12da29cf4227f/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:25:57.481949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ea55-67a5-4316-be32-a9214d4f8ece None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.482404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ea55-67a5-4316-be32-a9214d4f8ece None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.482512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9ea55-67a5-4316-be32-a9214d4f8ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.501582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8dc9ea55-67a5-4316-be32-a9214d4f8ece None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:57.502767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8dc9ea55-67a5-4316-be32-a9214d4f8ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:57.511343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:57.561611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 949/1887] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:57.571653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:57.573387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:57.631006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f792-a4fe-4fc0-8391-cf421db5ff7f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:57.635428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:57.635967 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:57.636245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:57.636575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:57.645495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:57.646976 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:57.656601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 939/1888] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:25:58.509473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307f80-9ae8-495d-a272-6a9545998d1f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:58.509974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307f80-9ae8-495d-a272-6a9545998d1f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:58.510088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46307f80-9ae8-495d-a272-6a9545998d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:58.539479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-46307f80-9ae8-495d-a272-6a9545998d1f None None] MFA Rules not processed for user `d949b76c01bf405cb8a12da29cf4227f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:25:58.540759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-46307f80-9ae8-495d-a272-6a9545998d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:58.607338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 950/1889] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:25:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:25:58.618519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:25:58.619958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:25:58.640390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:58.681208 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26442d39-ad22-46ee-b0eb-57fae42fbae4 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:25:58.684969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b090b7-7096-44f8-9073-7c429da9d662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:25:58.685625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b090b7-7096-44f8-9073-7c429da9d662 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:25:58.685907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b090b7-7096-44f8-9073-7c429da9d662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:25:58.686206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b090b7-7096-44f8-9073-7c429da9d662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:25:58.696021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b090b7-7096-44f8-9073-7c429da9d662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:25:58.697554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b090b7-7096-44f8-9073-7c429da9d662 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:25:58.707578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 940/1890] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:26:00.063138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:00.063622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:00.063735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:00.084818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] MFA Rules not processed for user `d949b76c01bf405cb8a12da29cf4227f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:00.086680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:00.093490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 951/1891] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:08.702891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=18 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:10.079357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=56 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:16.025906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded88a4-2e2b-4466-b70d-6069b1d74929 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:16.026835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded88a4-2e2b-4466-b70d-6069b1d74929 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:16.027238 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded88a4-2e2b-4466-b70d-6069b1d74929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:16.047209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1ded88a4-2e2b-4466-b70d-6069b1d74929 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:16.048965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1ded88a4-2e2b-4466-b70d-6069b1d74929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:16.122671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 941/1892] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:26:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:16.134966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:16.136512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:16.209362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7cf00-ff01-46eb-b915-e2ffb13932ca None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:16.214988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deed1e-d53d-4142-a02f-4941ff771830 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:16.215636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deed1e-d53d-4142-a02f-4941ff771830 service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:16.215916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deed1e-d53d-4142-a02f-4941ff771830 service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:16.216191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deed1e-d53d-4142-a02f-4941ff771830 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:16.225309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deed1e-d53d-4142-a02f-4941ff771830 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:16.227490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deed1e-d53d-4142-a02f-4941ff771830 service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:16.235697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 952/1893] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:26:21.889493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78aa5-a4d5-48b6-9cb2-0d2aaca20d83 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:21.890028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78aa5-a4d5-48b6-9cb2-0d2aaca20d83 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:21.890028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78aa5-a4d5-48b6-9cb2-0d2aaca20d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:21.920388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-40e78aa5-a4d5-48b6-9cb2-0d2aaca20d83 None None] MFA Rules not processed for user `6f35b75b70c141be869554ef0e30e21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:21.922805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-40e78aa5-a4d5-48b6-9cb2-0d2aaca20d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:22.043536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 942/1894] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:26:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:26:26.232238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=32 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:32.017487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=50 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:34.070719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073be48b-3cf1-4b4d-b06d-1c41fea49727 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:34.071793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073be48b-3cf1-4b4d-b06d-1c41fea49727 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:34.072176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073be48b-3cf1-4b4d-b06d-1c41fea49727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:34.100593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-073be48b-3cf1-4b4d-b06d-1c41fea49727 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:34.102250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-073be48b-3cf1-4b4d-b06d-1c41fea49727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:34.117975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 953/1895] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:26:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:34.149192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78aa5-a4d5-48b6-9cb2-0d2aaca20d83 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:34.176165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78aa5-a4d5-48b6-9cb2-0d2aaca20d83 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:34.200447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:34.202656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:34.203286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:34.208039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:34.223884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:34.226867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:34.238775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 943/1896] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:26:43.605884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9e8b-898f-46d4-acc5-10e97b7c61c3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:43.605884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9e8b-898f-46d4-acc5-10e97b7c61c3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:43.606697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9e8b-898f-46d4-acc5-10e97b7c61c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:43.655647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0fcc9e8b-898f-46d4-acc5-10e97b7c61c3 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:43.658653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0fcc9e8b-898f-46d4-acc5-10e97b7c61c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:43.682638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 954/1897] 10.222.0.46 () {58 vars in 967 bytes} [Wed Oct 19 13:26:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:43.709889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:43.723116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c7480-93fe-4b5a-9954-392b370ebf88 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:43.731172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:43.732066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:43.732512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:43.732945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:43.743241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:43.745223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:43.757272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 944/1898] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:26:44.619954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e02ec9-8149-4f1e-b733-2deb796b5faf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:44.620478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e02ec9-8149-4f1e-b733-2deb796b5faf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:44.620562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e02ec9-8149-4f1e-b733-2deb796b5faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:44.661794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c0e02ec9-8149-4f1e-b733-2deb796b5faf None None] MFA Rules not processed for user `815494a41aaa400c99841f38ffd50c63`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:44.664041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c0e02ec9-8149-4f1e-b733-2deb796b5faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:44.735826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 955/1899] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:26:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:46.222535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:46.225308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:46.269421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c7139-c8b3-432e-ae34-139098b523b8 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:46.282353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:46.283006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:46.283325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:46.283606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] PATH_INFO: `/v3/users/7dc9c651aefa4d1c8c5311eca45005e3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:46.284781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc9c651aefa4d1c8c5311eca45005e3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:46.286906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:46.349280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc9c651aefa4d1c8c5311eca45005e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.350790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc9c651aefa4d1c8c5311eca45005e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.359818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc9c651aefa4d1c8c5311eca45005e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.369253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc9c651aefa4d1c8c5311eca45005e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.390349 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9be08c5b-60f5-451f-8c87-2160ef1dbe81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc9c651aefa4d1c8c5311eca45005e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.398842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 945/1900] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:26:46 2022] DELETE /identity/v3/users/7dc9c651aefa4d1c8c5311eca45005e3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:26:46.605628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e02ec9-8149-4f1e-b733-2deb796b5faf None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:46.621256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e02ec9-8149-4f1e-b733-2deb796b5faf None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:46.706847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:46.707551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:46.707839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:46.708118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] PATH_INFO: `/v3/projects/c8db5cbe8fbd4854a0e438c62375bfbf` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:46.709922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8db5cbe8fbd4854a0e438c62375bfbf)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:46.711878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:46.757759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8db5cbe8fbd4854a0e438c62375bfbf', 'request_id': 'req-d6e6cbbe-8352-46be-a201-fe82841a0db9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.764242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8db5cbe8fbd4854a0e438c62375bfbf', 'request_id': 'req-d6e6cbbe-8352-46be-a201-fe82841a0db9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.769962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8db5cbe8fbd4854a0e438c62375bfbf', 'request_id': 'req-d6e6cbbe-8352-46be-a201-fe82841a0db9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.783281 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] The token cache is being invalidate because project c8db5cbe8fbd4854a0e438c62375bfbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:26:46.783575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.784234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d6e6cbbe-8352-46be-a201-fe82841a0db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:26:46.785743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 956/1901] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:26:46 2022] DELETE /identity/v3/projects/c8db5cbe8fbd4854a0e438c62375bfbf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:26:51.979300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728d038-5e5d-462f-a81c-fd660bc3dde6 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:51.979880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728d038-5e5d-462f-a81c-fd660bc3dde6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:51.980319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728d038-5e5d-462f-a81c-fd660bc3dde6 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:51.982058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 946/1902] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:26:51.990217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002d88-058b-44e4-bd48-72d18287ca4c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:51.990777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002d88-058b-44e4-bd48-72d18287ca4c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:51.990910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002d88-058b-44e4-bd48-72d18287ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.012799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-75002d88-058b-44e4-bd48-72d18287ca4c None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:52.014117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-75002d88-058b-44e4-bd48-72d18287ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:52.031828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:52.087046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 957/1903] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:52.099353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728d038-5e5d-462f-a81c-fd660bc3dde6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:52.101160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f728d038-5e5d-462f-a81c-fd660bc3dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:52.163614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728d038-5e5d-462f-a81c-fd660bc3dde6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:52.167187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed93c87-214e-4e1f-8655-8f918b94eac6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:52.167792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed93c87-214e-4e1f-8655-8f918b94eac6 service glance] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.168069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed93c87-214e-4e1f-8655-8f918b94eac6 service glance] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.168340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed93c87-214e-4e1f-8655-8f918b94eac6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.178918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed93c87-214e-4e1f-8655-8f918b94eac6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:52.180638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed93c87-214e-4e1f-8655-8f918b94eac6 service glance] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:52.191530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 947/1904] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:26:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:26:52.260636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d04d-9df6-4b61-ad87-aef87df63fed None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.261069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d04d-9df6-4b61-ad87-aef87df63fed None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.261416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d04d-9df6-4b61-ad87-aef87df63fed None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.262859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 958/1905] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:26:52.267458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.267744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.268023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.284824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.285109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.285388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.288373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] MFA Rules not processed for user `9b0ffc12a2fe49938b8a5ab56cd9721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:52.289598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:52.305673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:52.306852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:52.334217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:52.347225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 948/1906] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:26:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:52.355693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:52.357151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:52.367806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7624ab-16fe-4b06-9616-bf53a93bf371 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:52.369114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 959/1907] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:26:52.373121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808fdfe-9b8f-4b2e-a02f-9f8fe9d45025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:52.373732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fdfe-9b8f-4b2e-a02f-9f8fe9d45025 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.374009 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fdfe-9b8f-4b2e-a02f-9f8fe9d45025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.374280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808fdfe-9b8f-4b2e-a02f-9f8fe9d45025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.388630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:52.389981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808fdfe-9b8f-4b2e-a02f-9f8fe9d45025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:52.390099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:52.391641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808fdfe-9b8f-4b2e-a02f-9f8fe9d45025 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:52.404328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 949/1908] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:26:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:26:52.417129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3467f-513e-48ff-afdf-fdd9947939be None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:52.423660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db856a8-1799-433c-bdf6-107ff899f2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:52.424388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db856a8-1799-433c-bdf6-107ff899f2a6 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.424789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db856a8-1799-433c-bdf6-107ff899f2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.425136 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db856a8-1799-433c-bdf6-107ff899f2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.437423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db856a8-1799-433c-bdf6-107ff899f2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:52.440584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db856a8-1799-433c-bdf6-107ff899f2a6 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:52.463436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 960/1909] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:26:52.530237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68f46d-9ac9-41f5-a97d-fa4899dd643d None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.530622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68f46d-9ac9-41f5-a97d-fa4899dd643d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.530966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68f46d-9ac9-41f5-a97d-fa4899dd643d None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.532435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 950/1910] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:26:52.539386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6803f4e-ef65-4b79-b41e-6239f1b3761f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.539671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6803f4e-ef65-4b79-b41e-6239f1b3761f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.539969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6803f4e-ef65-4b79-b41e-6239f1b3761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.560970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d6803f4e-ef65-4b79-b41e-6239f1b3761f None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:52.562172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d6803f4e-ef65-4b79-b41e-6239f1b3761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:52.571558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 961/1911] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:26:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:52.582163 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68f46d-9ac9-41f5-a97d-fa4899dd643d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:52.593008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68f46d-9ac9-41f5-a97d-fa4899dd643d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:52.596459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:52.597049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:52.597328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:52.597600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:52.608152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:52.609581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:52.621148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 951/1912] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:26:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:26:56.293053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fcac2-313e-4729-b4ba-f8a45a17b7b5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:56.293599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fcac2-313e-4729-b4ba-f8a45a17b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:56.293599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fcac2-313e-4729-b4ba-f8a45a17b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:56.314271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7e9fcac2-313e-4729-b4ba-f8a45a17b7b5 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:56.315502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7e9fcac2-313e-4729-b4ba-f8a45a17b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:56.325588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 962/1913] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:26:56.339962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:56.341910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:56.356764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a89fa-9e8e-4dd7-9100-900be1d038e1 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:56.362284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:56.362867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:56.363179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:56.363454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:56.371459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:56.373030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:56.383064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 952/1914] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:26:59.788897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b80c7-a28a-43d7-82b3-db9bbb3a0cbc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:59.789406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b80c7-a28a-43d7-82b3-db9bbb3a0cbc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:59.789510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b80c7-a28a-43d7-82b3-db9bbb3a0cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:59.809010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-311b80c7-a28a-43d7-82b3-db9bbb3a0cbc None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:26:59.810195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-311b80c7-a28a-43d7-82b3-db9bbb3a0cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:59.863145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 963/1915] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:26:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:26:59.885372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:26:59.886795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:26:59.957217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82110-b004-4014-bf8f-25fd25af23c3 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:26:59.962370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:26:59.962977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:26:59.963292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:26:59.963577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:26:59.971697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:26:59.973293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:26:59.981884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 953/1916] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:26:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:27:00.705803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754d15-b6b4-41d5-95c0-157e77329d40 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:00.706191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754d15-b6b4-41d5-95c0-157e77329d40 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:00.706468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754d15-b6b4-41d5-95c0-157e77329d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:00.729152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3b754d15-b6b4-41d5-95c0-157e77329d40 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:00.730524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3b754d15-b6b4-41d5-95c0-157e77329d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:00.739108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 964/1917] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:00.757179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:00.769385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2f91-0bcc-4d2d-bf02-486210699887 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:00.776801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:00.777611 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:00.777966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:00.778204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:00.788544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:00.790560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:00.801404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 954/1918] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:27:10.720923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:10.798127 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=57 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:17.193950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:17.195222 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:17.195500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:17.217514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:17.218851 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:17.226892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 965/1919] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:17.241492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:17.252652 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616351d3-785e-4503-a8da-e987fe5e999b service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:17.258553 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c95b4-6cf7-4e72-8165-cfd5f03dc375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:17.259307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c95b4-6cf7-4e72-8165-cfd5f03dc375 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:17.259587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c95b4-6cf7-4e72-8165-cfd5f03dc375 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:17.259856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c95b4-6cf7-4e72-8165-cfd5f03dc375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:17.268414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c95b4-6cf7-4e72-8165-cfd5f03dc375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:17.270044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c95b4-6cf7-4e72-8165-cfd5f03dc375 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:17.280669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 955/1920] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:27:17.466777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:17.471184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:17.556106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03a791-f820-4224-9280-7214c5aa0ff0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:17.561276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:17.561899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:17.562178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:17.562450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:17.564325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:17.576839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:17.578439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:17.588498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 966/1921] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:27:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:27:20.726902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447008b9-49e2-40f7-ad13-7ba10b66f8ef None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:20.728112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447008b9-49e2-40f7-ad13-7ba10b66f8ef None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:20.728535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447008b9-49e2-40f7-ad13-7ba10b66f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:20.749190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-447008b9-49e2-40f7-ad13-7ba10b66f8ef None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:20.750399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-447008b9-49e2-40f7-ad13-7ba10b66f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:20.757600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 956/1922] 10.222.0.46 () {58 vars in 967 bytes} [Wed Oct 19 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:20.770104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:20.781475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d6e80-f8c1-4103-af96-73f238cbb911 service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:20.786949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:20.787723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:20.788001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:20.788273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:20.796121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:20.797683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:20.806094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 967/1923] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:27:21.403901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087400d-73d2-4353-b22b-5fcbaae9b749 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:21.404287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087400d-73d2-4353-b22b-5fcbaae9b749 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:21.404635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087400d-73d2-4353-b22b-5fcbaae9b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:21.427714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1087400d-73d2-4353-b22b-5fcbaae9b749 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:21.429781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1087400d-73d2-4353-b22b-5fcbaae9b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:21.446850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 957/1924] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:21.472738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:21.486645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c54aab-9947-4e06-9ee5-5f9230b6c8a5 service swift] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:21.493138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:21.494094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:21.494553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:21.495288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:21.504555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:21.506793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:21.516722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 968/1925] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:27:24.556038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31924-5547-4166-ac65-8ac48a3f741e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:24.556503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31924-5547-4166-ac65-8ac48a3f741e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:24.556612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31924-5547-4166-ac65-8ac48a3f741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:24.576275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-37f31924-5547-4166-ac65-8ac48a3f741e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:24.577457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-37f31924-5547-4166-ac65-8ac48a3f741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:24.586023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 958/1926] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:24.601915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:24.612895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31671a08-143d-4524-8dc2-fed8eceb4ae3 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:24.618334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87bb08-b490-4a48-907f-11e491eec5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:24.618923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87bb08-b490-4a48-907f-11e491eec5a4 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:24.619266 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87bb08-b490-4a48-907f-11e491eec5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:24.619543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87bb08-b490-4a48-907f-11e491eec5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:24.627525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87bb08-b490-4a48-907f-11e491eec5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:24.629096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87bb08-b490-4a48-907f-11e491eec5a4 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:24.638899 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 969/1927] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:27:34.571535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=15 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:34.634738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=53 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:40.876772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41172f-503d-47b6-8b00-a370d2caeb95 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:40.877308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41172f-503d-47b6-8b00-a370d2caeb95 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:40.877412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41172f-503d-47b6-8b00-a370d2caeb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:40.897070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3d41172f-503d-47b6-8b00-a370d2caeb95 None None] MFA Rules not processed for user `d949b76c01bf405cb8a12da29cf4227f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:40.898268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3d41172f-503d-47b6-8b00-a370d2caeb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:40.952409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 959/1928] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:27:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:50.945795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=25 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:54.469977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d358-c915-4252-a92a-785ce7397392 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:54.470500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d358-c915-4252-a92a-785ce7397392 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:54.470500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d358-c915-4252-a92a-785ce7397392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:54.490234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8da9d358-c915-4252-a92a-785ce7397392 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:54.492117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8da9d358-c915-4252-a92a-785ce7397392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:54.500155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 970/1929] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:54.520746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41172f-503d-47b6-8b00-a370d2caeb95 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:54.533770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41172f-503d-47b6-8b00-a370d2caeb95 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:54.539813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:54.540419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:54.540703 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:54.540979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:54.549101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:54.550758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:54.561098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 960/1930] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:27:57.734102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a4ad-ebdf-4866-aaae-a3ae24b95925 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:57.734612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a4ad-ebdf-4866-aaae-a3ae24b95925 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:57.734612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a4ad-ebdf-4866-aaae-a3ae24b95925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:57.754204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-acd1a4ad-ebdf-4866-aaae-a3ae24b95925 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:27:57.755442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-acd1a4ad-ebdf-4866-aaae-a3ae24b95925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:27:57.763921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 971/1931] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:27:57.786440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:27:57.797408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86881325-0cf6-4c31-b815-e463a15cad4a service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:27:57.802835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:27:57.803720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:27:57.804504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:27:57.804773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:27:57.812753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:27:57.814327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:27:57.824388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 961/1932] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:00.805801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6fb73-9759-44b7-87e4-04d781b3a728 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:00.806284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6fb73-9759-44b7-87e4-04d781b3a728 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:00.806464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6fb73-9759-44b7-87e4-04d781b3a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:00.826209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-45d6fb73-9759-44b7-87e4-04d781b3a728 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:00.827430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-45d6fb73-9759-44b7-87e4-04d781b3a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:00.835053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 972/1933] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:00.856630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:00.868233 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e189e-c35f-4b0c-b7ef-6d2bfd8fdd67 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:00.873684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:00.874218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:00.874495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:00.874767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:00.882800 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:00.885034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:00.894246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 962/1934] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:04.015671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626241-32d1-4388-988c-a54f2b1e326e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:04.016182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626241-32d1-4388-988c-a54f2b1e326e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:04.016277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626241-32d1-4388-988c-a54f2b1e326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:04.035918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-69626241-32d1-4388-988c-a54f2b1e326e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:04.037104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-69626241-32d1-4388-988c-a54f2b1e326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:04.044764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 973/1935] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:04.061871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:04.073467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aad277-6f85-4b63-b084-76c38cd7c120 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:04.078904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:04.079541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:04.079820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:04.080093 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:04.088813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:04.090413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:04.099622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 963/1936] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:09.264356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa947772-abbf-4c32-98f3-a4a5b2d162e8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:09.264925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa947772-abbf-4c32-98f3-a4a5b2d162e8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:09.264925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa947772-abbf-4c32-98f3-a4a5b2d162e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:09.285093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-aa947772-abbf-4c32-98f3-a4a5b2d162e8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:09.286327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-aa947772-abbf-4c32-98f3-a4a5b2d162e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:09.295058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 974/1937] 10.222.0.16 () {58 vars in 1016 bytes} [Wed Oct 19 13:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:09.419334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:09.431874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6633e-e0ab-48e3-b344-cc73e51ea6dc service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:09.437877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d3426-86ff-45fa-a3a0-e13a0a30ba36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:09.438903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d3426-86ff-45fa-a3a0-e13a0a30ba36 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:09.439359 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d3426-86ff-45fa-a3a0-e13a0a30ba36 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:09.439785 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d3426-86ff-45fa-a3a0-e13a0a30ba36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:09.455055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d3426-86ff-45fa-a3a0-e13a0a30ba36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:09.456699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d3426-86ff-45fa-a3a0-e13a0a30ba36 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:09.467570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 964/1938] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:17.811823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a1f8-755e-47f3-bfc0-6bd204d41950 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:17.812393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a1f8-755e-47f3-bfc0-6bd204d41950 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:17.812393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a1f8-755e-47f3-bfc0-6bd204d41950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:17.819784 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=16 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:17.833882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0529a1f8-755e-47f3-bfc0-6bd204d41950 None None] MFA Rules not processed for user `6f35b75b70c141be869554ef0e30e21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:17.835131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0529a1f8-755e-47f3-bfc0-6bd204d41950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:17.891377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 975/1939] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:17.980477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:17.980972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:17.981068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:17.999688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] MFA Rules not processed for user `8f85c5d88c324fd790b6282e714861de`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:18.000983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:18.057570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 965/1940] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:27.884627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=24 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:28.050455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=55 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:33.724142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdc2a-a580-4a8c-9d87-54a4eecb4c33 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:33.724635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdc2a-a580-4a8c-9d87-54a4eecb4c33 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:33.724738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdc2a-a580-4a8c-9d87-54a4eecb4c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:33.744529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-bbbbdc2a-a580-4a8c-9d87-54a4eecb4c33 None None] MFA Rules not processed for user `815494a41aaa400c99841f38ffd50c63`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:33.745741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bbbbdc2a-a580-4a8c-9d87-54a4eecb4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:33.799744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 976/1941] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:43.793172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=25 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:47.314475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:47.316090 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:47.331551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f68778-2b75-4405-9175-233f446bff6f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:47.340515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:47.341167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:47.341447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:47.341718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] PATH_INFO: `/v3/users/d949b76c01bf405cb8a12da29cf4227f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:47.342861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d949b76c01bf405cb8a12da29cf4227f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:47.344885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:47.398581 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd949b76c01bf405cb8a12da29cf4227f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.399323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd949b76c01bf405cb8a12da29cf4227f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.408036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd949b76c01bf405cb8a12da29cf4227f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.415636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd949b76c01bf405cb8a12da29cf4227f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.427887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-863c192b-9b87-4cb1-ac62-e2ad7fadcbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd949b76c01bf405cb8a12da29cf4227f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.433732 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 966/1942] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:28:47 2022] DELETE /identity/v3/users/d949b76c01bf405cb8a12da29cf4227f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:28:47.606046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdc2a-a580-4a8c-9d87-54a4eecb4c33 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:47.618922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdc2a-a580-4a8c-9d87-54a4eecb4c33 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:47.675777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:47.676413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:47.676698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:47.677242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] PATH_INFO: `/v3/projects/7062e651169f49e1a6dd2dd55b1f55f2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:47.678376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7062e651169f49e1a6dd2dd55b1f55f2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:47.680321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:47.725460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7062e651169f49e1a6dd2dd55b1f55f2', 'request_id': 'req-be711e22-d875-44f2-bf06-5294f5111d03'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.731648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7062e651169f49e1a6dd2dd55b1f55f2', 'request_id': 'req-be711e22-d875-44f2-bf06-5294f5111d03'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.737179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7062e651169f49e1a6dd2dd55b1f55f2', 'request_id': 'req-be711e22-d875-44f2-bf06-5294f5111d03'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.749589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] The token cache is being invalidate because project 7062e651169f49e1a6dd2dd55b1f55f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:28:47.749881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.750511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-be711e22-d875-44f2-bf06-5294f5111d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:28:47.752049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 977/1943] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:28:47 2022] DELETE /identity/v3/projects/7062e651169f49e1a6dd2dd55b1f55f2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:28:47.758365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b046e-17ac-480e-927b-e6269bc1e6ac None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:47.758656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b046e-17ac-480e-927b-e6269bc1e6ac None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:47.758936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b046e-17ac-480e-927b-e6269bc1e6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:47.778964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-522b046e-17ac-480e-927b-e6269bc1e6ac None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:47.780221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-522b046e-17ac-480e-927b-e6269bc1e6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:47.838048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 967/1944] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:47.845748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf06f-1ada-492e-b0f6-7a3ff75851e6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:47.846038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf06f-1ada-492e-b0f6-7a3ff75851e6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:47.846319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf06f-1ada-492e-b0f6-7a3ff75851e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:47.866270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-22dcf06f-1ada-492e-b0f6-7a3ff75851e6 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:47.867521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-22dcf06f-1ada-492e-b0f6-7a3ff75851e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:47.876144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 978/1945] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:47.880173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b046e-17ac-480e-927b-e6269bc1e6ac None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:47.890355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b046e-17ac-480e-927b-e6269bc1e6ac None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:47.895017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:47.895649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:47.895934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:47.896210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:47.896863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:28:47.897170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:47.898778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:47.910449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 968/1946] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:28:47.914626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf06f-1ada-492e-b0f6-7a3ff75851e6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:47.923942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf06f-1ada-492e-b0f6-7a3ff75851e6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:47.928863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:47.929459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:47.929740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:47.930012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:47.930655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:47.933101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:47.964053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 979/1947] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:28:47 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:28:47.965452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:47.975682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f657e-13a9-4bdd-9b10-0d3706f1b985 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:48.031445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:48.037111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:48.037419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:48.037680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:48.038323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:48.040678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:48.049634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:48.065477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 969/1948] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:28:47 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:28:48.069694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:48.080718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8841f1-0631-45a8-9457-935e316f408a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:48.085285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:48.085891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:48.086172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:48.086467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:48.087106 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:48.088829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:48.098533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 980/1949] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:28:48.102274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:48.112756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dcbe5-1e6f-48e6-8005-b014a7da7ace admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:48.117446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26444d3b-ab1a-44af-8eb5-7f8db77273b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:48.118053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444d3b-ab1a-44af-8eb5-7f8db77273b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:48.118338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444d3b-ab1a-44af-8eb5-7f8db77273b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:48.118613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444d3b-ab1a-44af-8eb5-7f8db77273b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:48.119312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26444d3b-ab1a-44af-8eb5-7f8db77273b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:48.121526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26444d3b-ab1a-44af-8eb5-7f8db77273b3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:48.132597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 970/1950] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:28:48.137065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:48.146918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49096-2034-4ed9-b06a-b9a9f3ec0c2a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:48.151590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:48.152238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:48.152523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:48.152804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] PATH_INFO: `/v3/projects/986e831265a94708933e7633d37492b8/users/854549631d1648bcaa0e8bc6bceea217/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:48.168029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986e831265a94708933e7633d37492b8, user_id=854549631d1648bcaa0e8bc6bceea217, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:48.170688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:48.184278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 981/1951] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:28:48 2022] PUT /identity/v3/projects/986e831265a94708933e7633d37492b8/users/854549631d1648bcaa0e8bc6bceea217/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:28:48.189191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251812f0-ddd7-41e7-9631-6d9a1ceecec3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:48.189482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251812f0-ddd7-41e7-9631-6d9a1ceecec3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:48.189763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251812f0-ddd7-41e7-9631-6d9a1ceecec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:48.208448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-251812f0-ddd7-41e7-9631-6d9a1ceecec3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:48.209662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-251812f0-ddd7-41e7-9631-6d9a1ceecec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:48.269106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 971/1952] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:48.278912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:48.280705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:48.312522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:48.340471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2ab95-4c14-45f4-8ec3-ff840ede96e1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:48.344122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:48.344732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:48.345010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:48.345285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:48.354718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:48.356208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:48.365521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 982/1953] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:52.324171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdb3c-045f-4046-bc37-e1bafb802321 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:52.324652 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdb3c-045f-4046-bc37-e1bafb802321 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:52.324770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdb3c-045f-4046-bc37-e1bafb802321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:52.354720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-47acdb3c-045f-4046-bc37-e1bafb802321 None None] MFA Rules not processed for user `854549631d1648bcaa0e8bc6bceea217`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:52.355983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-47acdb3c-045f-4046-bc37-e1bafb802321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:52.423941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 972/1954] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:52.428263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:52.438588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1a925-18f3-4fb5-ac49-c8fa2cf9f7fe service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:52.443145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:52.443743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:52.444020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:52.444369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:52.444915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:52.446809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:52.476607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 983/1955] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:28:52 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:28:52.481119 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acdb3c-045f-4046-bc37-e1bafb802321 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:52.492448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acdb3c-045f-4046-bc37-e1bafb802321 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:52.548242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:52.548855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:52.549137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:52.549410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:52.550058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:52.552269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:52.568845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:52.576258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 973/1956] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:28:52 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:28:52.580378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:52.591247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde498b6-1599-448e-9d26-5e226c2c1c41 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:52.595901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:52.596569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:52.596853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:52.597123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:52.597787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:52.599402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:52.610344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 984/1957] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:28:52.614385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:52.624308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517494f5-5f45-4581-8cf4-df310f259125 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:52.628971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:52.629617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:52.629889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:52.630170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] PATH_INFO: `/v3/projects/74464e32dca7451790cf8f0e3563ca68/users/d4f386c6f13f4cba8bf6344160617dfd/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:52.645299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74464e32dca7451790cf8f0e3563ca68, user_id=d4f386c6f13f4cba8bf6344160617dfd, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:52.648042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:52.664534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 974/1958] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:28:52 2022] PUT /identity/v3/projects/74464e32dca7451790cf8f0e3563ca68/users/d4f386c6f13f4cba8bf6344160617dfd/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:28:52.668543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:52.678943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed2fe8-df32-4859-bf7e-cc3fbc432c00 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:52.734893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999a5ac-a0d0-4082-a9ad-e1b8a6f5ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:52.735528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a5ac-a0d0-4082-a9ad-e1b8a6f5ba6b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:52.735808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a5ac-a0d0-4082-a9ad-e1b8a6f5ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:52.736186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a5ac-a0d0-4082-a9ad-e1b8a6f5ba6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:52.736829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999a5ac-a0d0-4082-a9ad-e1b8a6f5ba6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:52.738420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999a5ac-a0d0-4082-a9ad-e1b8a6f5ba6b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:52.747892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 985/1959] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:28:52.752042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:52.762833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419caba8-aa3a-4932-aae1-bed97cbe58b8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:52.767523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:52.768171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:52.768453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:52.768729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] PATH_INFO: `/v3/projects/74464e32dca7451790cf8f0e3563ca68/users/d4f386c6f13f4cba8bf6344160617dfd/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:52.770662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74464e32dca7451790cf8f0e3563ca68, user_id=d4f386c6f13f4cba8bf6344160617dfd, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:52.773330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:52.784074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 975/1960] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:28:52 2022] PUT /identity/v3/projects/74464e32dca7451790cf8f0e3563ca68/users/d4f386c6f13f4cba8bf6344160617dfd/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:28:58.208778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10a1f-2e82-413d-9c50-84508d75cc1c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:58.209177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10a1f-2e82-413d-9c50-84508d75cc1c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:58.209515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10a1f-2e82-413d-9c50-84508d75cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:58.282328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c0e10a1f-2e82-413d-9c50-84508d75cc1c None None] MFA Rules not processed for user `d4f386c6f13f4cba8bf6344160617dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:58.283451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c0e10a1f-2e82-413d-9c50-84508d75cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:58.392832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 986/1961] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:28:58.406909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:28:58.408839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:58.506667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d85a-4cd0-4503-a646-eb0ffd5f20d4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:28:58.514075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71092f-b58d-4fbf-8d21-9b2333ef8534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:28:58.514711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71092f-b58d-4fbf-8d21-9b2333ef8534 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:58.514999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71092f-b58d-4fbf-8d21-9b2333ef8534 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:58.515446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71092f-b58d-4fbf-8d21-9b2333ef8534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:58.587829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71092f-b58d-4fbf-8d21-9b2333ef8534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:28:58.590160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71092f-b58d-4fbf-8d21-9b2333ef8534 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:28:58.600865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 976/1962] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:28:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:28:59.824250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1df0c-5a93-45da-a671-1d42c24da07c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:59.824804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1df0c-5a93-45da-a671-1d42c24da07c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:59.824804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1df0c-5a93-45da-a671-1d42c24da07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:59.839017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae236-0886-4465-bf08-942c16073bca None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:28:59.840315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae236-0886-4465-bf08-942c16073bca None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:28:59.840805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae236-0886-4465-bf08-942c16073bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:28:59.854731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-67f1df0c-5a93-45da-a671-1d42c24da07c None None] MFA Rules not processed for user `30c408bc33b84cadb1b16ac2327011d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:59.856021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-67f1df0c-5a93-45da-a671-1d42c24da07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:59.860456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a83ae236-0886-4465-bf08-942c16073bca None None] MFA Rules not processed for user `854549631d1648bcaa0e8bc6bceea217`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:28:59.861625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a83ae236-0886-4465-bf08-942c16073bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:28:59.868666 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 977/1963] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:28:59.876735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:59.923043 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 987/1964] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:28:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:29:04.196129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae236-0886-4465-bf08-942c16073bca None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:04.254405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae236-0886-4465-bf08-942c16073bca None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:04.258191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:04.258802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:04.259114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:04.259385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:04.261391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:04.272763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:04.279244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:04.281113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:04.295144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 978/1965] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:05.738426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1df0c-5a93-45da-a671-1d42c24da07c None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:05.748425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1df0c-5a93-45da-a671-1d42c24da07c None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:05.751985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:05.752589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:05.752867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:05.753139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:05.754853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:05.769535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:05.771016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:05.783911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 988/1966] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:14.287484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:15.778575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=23 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:17.930792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:17.932269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:17.948677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68611c4c-3d9d-47a1-9d21-c9e1942cd65d service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:17.955014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:17.955877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:17.956162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:17.956438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:17.958184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:18.021420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:18.022984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:18.033040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 979/1967] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:21.726978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:21.738708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec520b96-d444-4dca-a1a9-7e30f9055d2b service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:21.744142 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:21.744732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:21.745007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:21.745277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:21.746965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:21.805584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:21.807128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:21.816223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 989/1968] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:28.028441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=28 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:28.069477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:28.079197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad63f39-75a6-4244-9b8e-80cf5c3ba878 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:28.082712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:28.083345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:28.083625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:28.083895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:28.093176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:28.094606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:28.103824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 980/1969] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:31.812014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=28 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:32.296313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:32.306189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b45397-42d8-4f08-906b-d4bf2ad8ee8f service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:32.310458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:32.311181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:32.311533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:32.311807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:32.313831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:32.325365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:32.326783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:32.334731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 990/1970] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:34.701004 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:34.702417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:34.713700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b8231-c689-40cb-abd9-2502da1659c7 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:34.717778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:34.718426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:34.718769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:34.719129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:34.720906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:34.785309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:34.786769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:34.797014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 981/1971] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:38.120229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:38.122861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:38.143181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf58364-7363-4e43-983a-284499c27398 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:38.148579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:38.149211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.149488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.149842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] PATH_INFO: `/v3/users/6f35b75b70c141be869554ef0e30e21d` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.151030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f35b75b70c141be869554ef0e30e21d)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:38.153202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:38.217261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f35b75b70c141be869554ef0e30e21d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.218185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f35b75b70c141be869554ef0e30e21d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.227228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f35b75b70c141be869554ef0e30e21d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.240373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f35b75b70c141be869554ef0e30e21d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.241032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-cd71a407-e308-4152-80e5-fc6d08a49d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f35b75b70c141be869554ef0e30e21d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.255237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 991/1972] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:29:38 2022] DELETE /identity/v3/users/6f35b75b70c141be869554ef0e30e21d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:29:38.432599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:38.444563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee653be-4a58-4859-9413-6b3f4d9fc646 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:38.509447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:38.510006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.510288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.510564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] PATH_INFO: `/v3/projects/a3939d685bfd4872810eea74ed7edc0f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.511734 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3939d685bfd4872810eea74ed7edc0f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:38.513696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:38.561952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3939d685bfd4872810eea74ed7edc0f', 'request_id': 'req-3624464f-0461-4595-be87-b3e397b4c1d9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.568352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3939d685bfd4872810eea74ed7edc0f', 'request_id': 'req-3624464f-0461-4595-be87-b3e397b4c1d9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.575766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3939d685bfd4872810eea74ed7edc0f', 'request_id': 'req-3624464f-0461-4595-be87-b3e397b4c1d9'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.585986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] The token cache is being invalidate because project a3939d685bfd4872810eea74ed7edc0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:29:38.586275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.586902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-3624464f-0461-4595-be87-b3e397b4c1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:29:38.588427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 982/1973] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:29:38 2022] DELETE /identity/v3/projects/a3939d685bfd4872810eea74ed7edc0f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:29:38.593423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d3bf2-91a5-4464-ae32-711326d130cc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.593708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d3bf2-91a5-4464-ae32-711326d130cc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.593985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d3bf2-91a5-4464-ae32-711326d130cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.614138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-216d3bf2-91a5-4464-ae32-711326d130cc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:29:38.615422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-216d3bf2-91a5-4464-ae32-711326d130cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:38.678657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 992/1974] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:29:38.687415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79040-78d6-40c5-99ba-611f7296e16c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.687706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79040-78d6-40c5-99ba-611f7296e16c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.687985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79040-78d6-40c5-99ba-611f7296e16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.708747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fab79040-78d6-40c5-99ba-611f7296e16c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:29:38.710231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fab79040-78d6-40c5-99ba-611f7296e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:38.718856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 983/1975] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:29:38.723166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d3bf2-91a5-4464-ae32-711326d130cc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:38.735022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d3bf2-91a5-4464-ae32-711326d130cc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:38.740290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:38.741112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.741404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.741680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.742332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:29:38.742639 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:38.744319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:38.757327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 993/1976] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:29:38.761475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79040-78d6-40c5-99ba-611f7296e16c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:38.768156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:38.772215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79040-78d6-40c5-99ba-611f7296e16c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:38.779452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:38.780677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.780964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.781232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.781886 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:38.784336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:38.814251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 984/1977] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:29:38 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:29:38.818351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:38.831037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcb69e-ad63-4189-a79d-e32cfd7f8fab admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:38.879672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:38.895009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:38.895667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.895945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.896213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.896860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:38.898794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:38.924585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 994/1978] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:29:38 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:29:38.926036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:38.936560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf83b-7279-4693-9626-2bda18625624 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:38.941385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:38.942003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.942285 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.942559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.944021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:38.944879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:38.955709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 985/1979] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:29:38.959687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:38.970423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93a57d-c0e7-4e69-8876-20427100ab60 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:38.976087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bda18c-0974-4a15-8f65-0a8e524df98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:38.976727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bda18c-0974-4a15-8f65-0a8e524df98a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:38.977014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bda18c-0974-4a15-8f65-0a8e524df98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:38.977293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bda18c-0974-4a15-8f65-0a8e524df98a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:38.977938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bda18c-0974-4a15-8f65-0a8e524df98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:38.979610 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bda18c-0974-4a15-8f65-0a8e524df98a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:38.991317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 995/1980] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:29:38.995502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.005543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf563b-d663-470a-8147-d974d89e7b5d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.010243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.010891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.011210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.011541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] PATH_INFO: `/v3/projects/4e1840f6a10c43078a093e4ef4398e47/users/8df3bb4afe32448a903fd9a9e1ab7577/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.025779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1840f6a10c43078a093e4ef4398e47, user_id=8df3bb4afe32448a903fd9a9e1ab7577, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.029010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.041533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 986/1981] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:29:38 2022] PUT /identity/v3/projects/4e1840f6a10c43078a093e4ef4398e47/users/8df3bb4afe32448a903fd9a9e1ab7577/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:29:39.053612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef400a0d-6e95-4351-a9c2-a3b76b70cf5d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.053901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef400a0d-6e95-4351-a9c2-a3b76b70cf5d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.054179 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef400a0d-6e95-4351-a9c2-a3b76b70cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.082062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ef400a0d-6e95-4351-a9c2-a3b76b70cf5d None None] MFA Rules not processed for user `8df3bb4afe32448a903fd9a9e1ab7577`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:29:39.083310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ef400a0d-6e95-4351-a9c2-a3b76b70cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:39.145375 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 996/1982] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:29:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:29:39.149941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.213072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44dab-6470-42e8-8332-83150d3a4434 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.218414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.219020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.219351 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.219620 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.220287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.222751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.249168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 987/1983] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:29:39 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:29:39.253090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef400a0d-6e95-4351-a9c2-a3b76b70cf5d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.264424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef400a0d-6e95-4351-a9c2-a3b76b70cf5d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.326574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.327227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.327506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.327775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.328401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.330292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.353025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 997/1984] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:29:39 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:29:39.357131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.367435 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6cab0-7556-41f6-8136-1e551033756b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.372114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.372733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.372997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.373284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.373912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.375573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.386262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 988/1985] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:29:39.390965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.400903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8610-5201-4583-981f-d612246c0444 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.406077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.406754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.407038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.407344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] PATH_INFO: `/v3/projects/06d64ffd8a5e4d1090d617ca12b48100/users/c9055bd6bc204583a79c9d9c2e4d6f01/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.423573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d64ffd8a5e4d1090d617ca12b48100, user_id=c9055bd6bc204583a79c9d9c2e4d6f01, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.426509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.441343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 998/1986] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:29:39 2022] PUT /identity/v3/projects/06d64ffd8a5e4d1090d617ca12b48100/users/c9055bd6bc204583a79c9d9c2e4d6f01/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:29:39.445495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.463747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11a845-6dbe-4733-936f-f4e56af2adfb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.535852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcce27-5514-4477-825a-dc7df3a5c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.536688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcce27-5514-4477-825a-dc7df3a5c9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.536975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcce27-5514-4477-825a-dc7df3a5c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.537253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcce27-5514-4477-825a-dc7df3a5c9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.537910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcce27-5514-4477-825a-dc7df3a5c9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.539568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcce27-5514-4477-825a-dc7df3a5c9f9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.551052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 989/1987] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:29:39.555212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.566204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e886c-b6c9-45bb-b3ae-629ab7d87634 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.571197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.571866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.572149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.572450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] PATH_INFO: `/v3/projects/06d64ffd8a5e4d1090d617ca12b48100/users/c9055bd6bc204583a79c9d9c2e4d6f01/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.574368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d64ffd8a5e4d1090d617ca12b48100, user_id=c9055bd6bc204583a79c9d9c2e4d6f01, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.577775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.589595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 999/1988] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:29:39 2022] PUT /identity/v3/projects/06d64ffd8a5e4d1090d617ca12b48100/users/c9055bd6bc204583a79c9d9c2e4d6f01/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:29:39.599879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad848-c4d0-4f9e-aead-4a72116a9c9b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.600322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad848-c4d0-4f9e-aead-4a72116a9c9b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.600813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad848-c4d0-4f9e-aead-4a72116a9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.630557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8c0ad848-c4d0-4f9e-aead-4a72116a9c9b None None] MFA Rules not processed for user `c9055bd6bc204583a79c9d9c2e4d6f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:29:39.631828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8c0ad848-c4d0-4f9e-aead-4a72116a9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:39.637875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:39.707237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 990/1989] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:29:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:29:39.718510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.720270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:39.730510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:39.779063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bdf5c-e644-4b29-ac2f-ef5ddfcd7e75 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.782646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.783282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.783561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.783830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.792797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.794763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.805451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1000/1990] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:39.884645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad848-c4d0-4f9e-aead-4a72116a9c9b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:39.894186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad848-c4d0-4f9e-aead-4a72116a9c9b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:39.898085 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e49c0-1bc7-4379-b451-1aac5f3e02a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:39.898697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e49c0-1bc7-4379-b451-1aac5f3e02a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:39.898983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e49c0-1bc7-4379-b451-1aac5f3e02a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:39.899294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e49c0-1bc7-4379-b451-1aac5f3e02a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:39.956559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e49c0-1bc7-4379-b451-1aac5f3e02a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:39.958015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e49c0-1bc7-4379-b451-1aac5f3e02a0 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:39.966978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 991/1991] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:42.410567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:42.411943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:42.510136 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1d015-56f9-4faf-a464-219be3bbce17 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:42.516016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:42.516650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:42.516937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:42.517212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:42.519117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:42.533961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:42.535832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:42.551579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1001/1992] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:46.413343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:46.413875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:46.414045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:46.434702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] MFA Rules not processed for user `815494a41aaa400c99841f38ffd50c63`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:29:46.435964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:46.489592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 992/1993] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:29:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:29:46.790755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:46.792306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:46.848557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca172-652f-41ff-974d-dd0b8814cedf service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:46.852131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0126ebd-5c16-4902-a27f-fd774960948b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:46.852736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0126ebd-5c16-4902-a27f-fd774960948b service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:46.853020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0126ebd-5c16-4902-a27f-fd774960948b service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:46.853294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0126ebd-5c16-4902-a27f-fd774960948b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:46.854973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e0126ebd-5c16-4902-a27f-fd774960948b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:46.864880 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0126ebd-5c16-4902-a27f-fd774960948b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:46.866330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0126ebd-5c16-4902-a27f-fd774960948b service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:46.874779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1002/1994] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:47.213124 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:47.214649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:47.285578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:47.310055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950dba-5d97-4fea-bf72-dd736b4e7814 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:47.315289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:47.316038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:47.316344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:47.316593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:47.318393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:47.332697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:47.334632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:47.350231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 993/1995] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:29:47.759483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:47.759770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:47.760075 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:47.780276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:29:47.781534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:47.815757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:47.841008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1003/1996] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:29:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:29:47.887770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:47.889258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:47.961224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf935-447d-4376-8ac1-36ea8a0966d8 service placement] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:47.968770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:47.969396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:47.969712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:47.970055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:47.979317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:47.981584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:47.990281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 994/1997] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:29:49.157698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:29:49.160341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:49.192816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2034-38c5-4921-ae36-d343ee4087ab None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:29:49.199120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e679a-0c5b-4e19-ae17-9947bf7e390b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:29:49.200062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e679a-0c5b-4e19-ae17-9947bf7e390b service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:29:49.200595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e679a-0c5b-4e19-ae17-9947bf7e390b service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:29:49.201172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e679a-0c5b-4e19-ae17-9947bf7e390b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:29:49.203381 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e95e679a-0c5b-4e19-ae17-9947bf7e390b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:29:49.231446 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e679a-0c5b-4e19-ae17-9947bf7e390b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:29:49.233852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e679a-0c5b-4e19-ae17-9947bf7e390b service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:29:49.251622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1004/1998] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:29:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:29:57.986423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=43 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:59.245089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=14 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:03.673439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:03.683062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033ac15-dbcf-422b-9777-100a819f7fa9 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:03.686718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e19234-2122-49e1-9de5-a8f21d641dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:03.687355 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19234-2122-49e1-9de5-a8f21d641dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:03.687637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19234-2122-49e1-9de5-a8f21d641dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:03.687914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e19234-2122-49e1-9de5-a8f21d641dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:03.689668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a9e19234-2122-49e1-9de5-a8f21d641dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:03.699018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e19234-2122-49e1-9de5-a8f21d641dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:03.700576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e19234-2122-49e1-9de5-a8f21d641dc7 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:03.708415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 995/1999] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:03.828017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72272-d92b-4085-abc6-301c1db34aa3 None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:03.828568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72272-d92b-4085-abc6-301c1db34aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:03.828568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72272-d92b-4085-abc6-301c1db34aa3 None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:03.829939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1005/2000] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:30:03.836095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef365e2-7fe0-44fc-9b50-546c28614514 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:03.836384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef365e2-7fe0-44fc-9b50-546c28614514 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:03.836658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef365e2-7fe0-44fc-9b50-546c28614514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:03.857069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6ef365e2-7fe0-44fc-9b50-546c28614514 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:03.858398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6ef365e2-7fe0-44fc-9b50-546c28614514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:03.867881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 996/2001] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:30:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:03.879286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa72272-d92b-4085-abc6-301c1db34aa3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:03.881050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-afa72272-d92b-4085-abc6-301c1db34aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:03.945821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa72272-d92b-4085-abc6-301c1db34aa3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:03.951560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289c84d-4de2-4a2c-ba08-f47288296138 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:03.952182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c84d-4de2-4a2c-ba08-f47288296138 service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:03.952527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c84d-4de2-4a2c-ba08-f47288296138 service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:03.952780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289c84d-4de2-4a2c-ba08-f47288296138 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:03.964363 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289c84d-4de2-4a2c-ba08-f47288296138 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:03.966443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289c84d-4de2-4a2c-ba08-f47288296138 service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:03.979303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1006/2002] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:04.046899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17c45-84d7-4aac-814e-88959c3160ec None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:04.047209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17c45-84d7-4aac-814e-88959c3160ec None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:04.047486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17c45-84d7-4aac-814e-88959c3160ec None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:04.048868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 997/2003] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:30:04.053828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e7c4-c53a-41fe-a7ee-bacde4a4a57e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:04.054120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e7c4-c53a-41fe-a7ee-bacde4a4a57e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:04.054397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78e7c4-c53a-41fe-a7ee-bacde4a4a57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:04.075295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-5c78e7c4-c53a-41fe-a7ee-bacde4a4a57e None None] MFA Rules not processed for user `9b0ffc12a2fe49938b8a5ab56cd9721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:04.076494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5c78e7c4-c53a-41fe-a7ee-bacde4a4a57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:04.082983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1007/2004] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:30:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:04.095226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd17c45-84d7-4aac-814e-88959c3160ec None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:04.106738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd17c45-84d7-4aac-814e-88959c3160ec None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:04.110341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40fe26-a36a-4c05-8df9-b5ee9265d69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:04.110913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40fe26-a36a-4c05-8df9-b5ee9265d69a service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:04.111232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40fe26-a36a-4c05-8df9-b5ee9265d69a service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:04.111506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40fe26-a36a-4c05-8df9-b5ee9265d69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:04.118382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40fe26-a36a-4c05-8df9-b5ee9265d69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:04.119837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40fe26-a36a-4c05-8df9-b5ee9265d69a service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:04.128332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 998/2005] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:04.153635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78e7c4-c53a-41fe-a7ee-bacde4a4a57e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:04.166462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78e7c4-c53a-41fe-a7ee-bacde4a4a57e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:04.172405 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:04.173032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:04.173308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:04.173576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:04.175619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:04.215768 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2ea7b-34bf-453b-b2f6-3d88626a1b52 None None] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:04.215989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2ea7b-34bf-453b-b2f6-3d88626a1b52 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:04.216310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2ea7b-34bf-453b-b2f6-3d88626a1b52 None None] PATH_INFO: `/` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:04.217731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 999/2006] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:30:04.223203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937470a-6fd5-4038-ac57-56ff8cf5fef9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:04.223516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937470a-6fd5-4038-ac57-56ff8cf5fef9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:04.223792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937470a-6fd5-4038-ac57-56ff8cf5fef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:04.240530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:04.242223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:04.243330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3937470a-6fd5-4038-ac57-56ff8cf5fef9 None None] MFA Rules not processed for user `c1433a2c778346a09a10845139967c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:04.244606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3937470a-6fd5-4038-ac57-56ff8cf5fef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:04.252584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1008/2007] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:04.254404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1000/2008] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:30:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:30:04.265553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:04.274868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb689d5-852f-4dcd-81ab-f6f99c2e3043 service nova] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:04.278720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:04.279386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:04.279671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:04.279949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:04.290160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:04.291681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:04.303483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1009/2009] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:06.249250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192756-140a-4524-b4dc-f479c0c36a06 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:06.249761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192756-140a-4524-b4dc-f479c0c36a06 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:06.249856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192756-140a-4524-b4dc-f479c0c36a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:06.272243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-9d192756-140a-4524-b4dc-f479c0c36a06 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:06.273527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-9d192756-140a-4524-b4dc-f479c0c36a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:06.282695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1001/2010] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:30:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:06.294909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:06.307797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c54d-c674-4de2-9e79-698b92527972 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:06.313080 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509dae5-daec-49ad-ba8f-d1ba0ba17dc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:06.313846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509dae5-daec-49ad-ba8f-d1ba0ba17dc2 service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:06.314272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509dae5-daec-49ad-ba8f-d1ba0ba17dc2 service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:06.314562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509dae5-daec-49ad-ba8f-d1ba0ba17dc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:06.323480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509dae5-daec-49ad-ba8f-d1ba0ba17dc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:06.325717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509dae5-daec-49ad-ba8f-d1ba0ba17dc2 service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:06.334499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1010/2011] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:30:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:30:10.469255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192756-140a-4524-b4dc-f479c0c36a06 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:10.542274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192756-140a-4524-b4dc-f479c0c36a06 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:10.547930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:10.548580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:10.548854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:10.549121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] PATH_INFO: `/v3/users/8df3bb4afe32448a903fd9a9e1ab7577` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:10.550525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df3bb4afe32448a903fd9a9e1ab7577)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:10.552550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:10.610031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df3bb4afe32448a903fd9a9e1ab7577'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:10.610617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df3bb4afe32448a903fd9a9e1ab7577'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:10.617985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df3bb4afe32448a903fd9a9e1ab7577'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:10.626248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df3bb4afe32448a903fd9a9e1ab7577'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:10.639926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df3bb4afe32448a903fd9a9e1ab7577'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:10.646219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1002/2012] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:10 2022] DELETE /identity/v3/users/8df3bb4afe32448a903fd9a9e1ab7577 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:10.650819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:10.651398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:10.651398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:10.673383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:10.675258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:10.751007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1011/2013] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:10.758591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:10.760072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:10.803353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:10.829248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5b1c1-448c-4069-ad1f-af6eabb9d99e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:10.833190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:10.833823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:10.834273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:10.834582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:10.845380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:10.846844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:10.869555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1003/2014] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:11.159901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:11.162031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:11.179200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689045ed-c2c5-4150-b534-c8ec6f5582d6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:11.184985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:11.185702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:11.185991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:11.186265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] PATH_INFO: `/v3/projects/4e1840f6a10c43078a093e4ef4398e47` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:11.201009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1840f6a10c43078a093e4ef4398e47)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:11.204236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:11.207253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:11.261519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1840f6a10c43078a093e4ef4398e47', 'request_id': 'req-2c77b5a2-dfe8-4890-995b-26a329e181ee'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.268950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1840f6a10c43078a093e4ef4398e47', 'request_id': 'req-2c77b5a2-dfe8-4890-995b-26a329e181ee'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.290686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1840f6a10c43078a093e4ef4398e47', 'request_id': 'req-2c77b5a2-dfe8-4890-995b-26a329e181ee'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.366161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] The token cache is being invalidate because project 4e1840f6a10c43078a093e4ef4398e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:11.366442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.367376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.369875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1012/2015] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:11 2022] DELETE /identity/v3/projects/4e1840f6a10c43078a093e4ef4398e47 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:11.374475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:11.385106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4776017-3b13-443b-a41c-c14294bf2fec service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:11.463024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:11.464105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:11.464558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:11.465047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] PATH_INFO: `/v3/users/c9055bd6bc204583a79c9d9c2e4d6f01` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:11.466417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9055bd6bc204583a79c9d9c2e4d6f01)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:11.468606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:11.528261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9055bd6bc204583a79c9d9c2e4d6f01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.529413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9055bd6bc204583a79c9d9c2e4d6f01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.537943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9055bd6bc204583a79c9d9c2e4d6f01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.548081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9055bd6bc204583a79c9d9c2e4d6f01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.561756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-ab8b4b57-67f2-476d-81f2-52bbcdb0ac17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9055bd6bc204583a79c9d9c2e4d6f01'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:11.567883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1004/2016] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:11 2022] DELETE /identity/v3/users/c9055bd6bc204583a79c9d9c2e4d6f01 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:11.852442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:11.854175 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:11.870093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b5a2-dfe8-4890-995b-26a329e181ee admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:11.938756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:11.939406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:11.939692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:11.939966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] PATH_INFO: `/v3/projects/06d64ffd8a5e4d1090d617ca12b48100` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:11.941127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d64ffd8a5e4d1090d617ca12b48100)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:11.943026 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:11.996678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d64ffd8a5e4d1090d617ca12b48100', 'request_id': 'req-300c2a99-0221-4d95-afad-a64f8e689a52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:12.003503 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d64ffd8a5e4d1090d617ca12b48100', 'request_id': 'req-300c2a99-0221-4d95-afad-a64f8e689a52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:12.009380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d64ffd8a5e4d1090d617ca12b48100', 'request_id': 'req-300c2a99-0221-4d95-afad-a64f8e689a52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:12.024952 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] The token cache is being invalidate because project 06d64ffd8a5e4d1090d617ca12b48100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:12.025269 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:12.025903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-300c2a99-0221-4d95-afad-a64f8e689a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:12.027998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1013/2017] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:11 2022] DELETE /identity/v3/projects/06d64ffd8a5e4d1090d617ca12b48100 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:12.032922 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b862ff-9974-4039-b34e-fae80246f6c3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.033123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b862ff-9974-4039-b34e-fae80246f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.033415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b862ff-9974-4039-b34e-fae80246f6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.054158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c2b862ff-9974-4039-b34e-fae80246f6c3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:12.055399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c2b862ff-9974-4039-b34e-fae80246f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:12.108593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:12.121835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1005/2018] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:12.132070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319bcf-86e8-4e88-bc9d-dc4f8ac9d2b9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.132562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319bcf-86e8-4e88-bc9d-dc4f8ac9d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.132889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319bcf-86e8-4e88-bc9d-dc4f8ac9d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.155929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-04319bcf-86e8-4e88-bc9d-dc4f8ac9d2b9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:12.157290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-04319bcf-86e8-4e88-bc9d-dc4f8ac9d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:12.165753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1014/2019] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:12.169840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b862ff-9974-4039-b34e-fae80246f6c3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.181141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b862ff-9974-4039-b34e-fae80246f6c3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.186488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.187295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.187710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.188054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.188861 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:12.189181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.190874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.204713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1006/2020] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:30:12.208722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319bcf-86e8-4e88-bc9d-dc4f8ac9d2b9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.219626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319bcf-86e8-4e88-bc9d-dc4f8ac9d2b9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.224374 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.225039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.225319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.225591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.226262 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.228200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.243780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:12.258817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1015/2021] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:12 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:12.264246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.275180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44c43-6b0d-4e53-8533-3c406ce9ad5c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.337956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.338592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.338847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.339142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.339814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.344051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.366122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1007/2022] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:12 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:12.370490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.381476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214dca9-8844-452f-91c5-7ff2d68c4b99 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.386270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.387550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.387838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.388113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.388893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.390616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.402264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1016/2023] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:12.406675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.417606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473b22b-900b-4032-981d-def1feb9b944 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.422356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd75ca7-f4e9-4691-859e-d8601ad69f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.422972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd75ca7-f4e9-4691-859e-d8601ad69f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.423287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd75ca7-f4e9-4691-859e-d8601ad69f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.423586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd75ca7-f4e9-4691-859e-d8601ad69f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.424237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd75ca7-f4e9-4691-859e-d8601ad69f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.426118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd75ca7-f4e9-4691-859e-d8601ad69f63 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.444113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1008/2024] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:12.451141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.459267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255575-000e-4383-a2b6-815b772f3f52 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.464292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.465000 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.465285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.465583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] PATH_INFO: `/v3/projects/f76ca801487a46bf8b6047bc17d3c60a/users/9c0339ea7f7c4a01a5928880b2498282/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.489193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76ca801487a46bf8b6047bc17d3c60a, user_id=9c0339ea7f7c4a01a5928880b2498282, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.491993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.508736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1017/2025] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:12 2022] PUT /identity/v3/projects/f76ca801487a46bf8b6047bc17d3c60a/users/9c0339ea7f7c4a01a5928880b2498282/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:12.517593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a41cd-0411-481f-b4d2-2d922dea9277 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.517875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a41cd-0411-481f-b4d2-2d922dea9277 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.518324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a41cd-0411-481f-b4d2-2d922dea9277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.547893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f25a41cd-0411-481f-b4d2-2d922dea9277 None None] MFA Rules not processed for user `9c0339ea7f7c4a01a5928880b2498282`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:12.549115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f25a41cd-0411-481f-b4d2-2d922dea9277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:12.622456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1009/2026] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:12.627200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.715995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019028e-539f-413c-a3a1-731c7b16421d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.725565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.726201 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.726486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.726760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.727451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.729543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.768962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1018/2027] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:12 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:12.773029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a41cd-0411-481f-b4d2-2d922dea9277 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.784685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a41cd-0411-481f-b4d2-2d922dea9277 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.836595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:12.850069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.850815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.851386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.851749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.855992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.858109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.883406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1010/2028] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:12 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:12.884761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.895971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb216e21-3010-4c11-80b7-3db2b86bb4ce admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.900933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.901559 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.901834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.902139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.902833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.904500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.916115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1019/2029] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:12.920775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.932185 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdbbf1-3af3-4939-adb1-339f68e821e9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:12.937735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:12.938411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:12.938702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:12.938982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] PATH_INFO: `/v3/projects/ba00aa71a8224d978deeb7bfc5b4694e/users/b34f2297a42a419cbed5debd07738d65/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:12.955522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba00aa71a8224d978deeb7bfc5b4694e, user_id=b34f2297a42a419cbed5debd07738d65, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:12.958212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:12.972432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1011/2030] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:12 2022] PUT /identity/v3/projects/ba00aa71a8224d978deeb7bfc5b4694e/users/b34f2297a42a419cbed5debd07738d65/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:12.976547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:12.989146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4acd1-76f1-43ad-a9f4-145f13db76d0 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:13.050148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d907cb-d047-4209-a3ee-a8e8a41db9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:13.050958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d907cb-d047-4209-a3ee-a8e8a41db9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:13.051503 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d907cb-d047-4209-a3ee-a8e8a41db9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:13.051891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d907cb-d047-4209-a3ee-a8e8a41db9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:13.052706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d907cb-d047-4209-a3ee-a8e8a41db9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:13.054429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d907cb-d047-4209-a3ee-a8e8a41db9c9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:13.065835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1020/2031] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:13.070111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:13.081352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e21d4-d7e4-4365-be57-462df332f3d9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:13.086225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:13.086924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:13.087248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:13.087528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] PATH_INFO: `/v3/projects/ba00aa71a8224d978deeb7bfc5b4694e/users/b34f2297a42a419cbed5debd07738d65/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:13.089467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba00aa71a8224d978deeb7bfc5b4694e, user_id=b34f2297a42a419cbed5debd07738d65, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:13.092253 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:13.103548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1012/2032] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:13 2022] PUT /identity/v3/projects/ba00aa71a8224d978deeb7bfc5b4694e/users/b34f2297a42a419cbed5debd07738d65/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:13.114225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcb968-500e-41e1-b3ad-dd26d15be2c3 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:13.114515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcb968-500e-41e1-b3ad-dd26d15be2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:13.114798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcb968-500e-41e1-b3ad-dd26d15be2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:13.145966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a7bcb968-500e-41e1-b3ad-dd26d15be2c3 None None] MFA Rules not processed for user `b34f2297a42a419cbed5debd07738d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:13.147818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7bcb968-500e-41e1-b3ad-dd26d15be2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:13.170322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:13.234424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1021/2033] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:13.242602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:13.244597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:13.313336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56070c7b-6cfa-4cee-844d-8630b1336d71 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:13.317286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ba781-1033-4721-a770-153ec6a98f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:13.317979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba781-1033-4721-a770-153ec6a98f65 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:13.318263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba781-1033-4721-a770-153ec6a98f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:13.318608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba781-1033-4721-a770-153ec6a98f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:13.381046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ba781-1033-4721-a770-153ec6a98f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:13.384877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ba781-1033-4721-a770-153ec6a98f65 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:13.396519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1013/2034] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:16.327617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcb968-500e-41e1-b3ad-dd26d15be2c3 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:16.344818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcb968-500e-41e1-b3ad-dd26d15be2c3 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:16.348402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:16.349012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:16.349286 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:16.349556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:16.359845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:16.363116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:16.372739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1022/2035] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:23.391812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:24.021699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa002-138d-4554-b037-a86d5b7fef0f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:24.022272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa002-138d-4554-b037-a86d5b7fef0f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:24.022557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa002-138d-4554-b037-a86d5b7fef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:24.047276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-a42fa002-138d-4554-b037-a86d5b7fef0f None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:24.048499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a42fa002-138d-4554-b037-a86d5b7fef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:24.111876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1014/2036] 10.222.0.46 () {58 vars in 967 bytes} [Wed Oct 19 13:30:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:24.126809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:24.128756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:24.216772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911acca-ccc0-4099-9b60-6017cb943ded service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:24.222298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d85e7-e55f-4dc3-9a51-c3e8b1f966fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:24.222925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d85e7-e55f-4dc3-9a51-c3e8b1f966fb service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:24.223233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d85e7-e55f-4dc3-9a51-c3e8b1f966fb service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:24.223507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d85e7-e55f-4dc3-9a51-c3e8b1f966fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:24.233065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d85e7-e55f-4dc3-9a51-c3e8b1f966fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:24.235190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d85e7-e55f-4dc3-9a51-c3e8b1f966fb service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:24.249134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1023/2037] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:30:29.025084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fa002-138d-4554-b037-a86d5b7fef0f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:29.086642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fa002-138d-4554-b037-a86d5b7fef0f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:29.091905 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:29.092486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:29.092764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:29.093035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] PATH_INFO: `/v3/users/9c0339ea7f7c4a01a5928880b2498282` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:29.094262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0339ea7f7c4a01a5928880b2498282)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:29.096255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:29.140897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0339ea7f7c4a01a5928880b2498282'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.141575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0339ea7f7c4a01a5928880b2498282'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.148389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0339ea7f7c4a01a5928880b2498282'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.157451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0339ea7f7c4a01a5928880b2498282'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.169999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0339ea7f7c4a01a5928880b2498282'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.176152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1015/2038] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:29 2022] DELETE /identity/v3/users/9c0339ea7f7c4a01a5928880b2498282 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:29.180603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:29.181049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:29.181192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:29.201631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:29.202836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:29.260300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1024/2039] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:29.270531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:29.271953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:29.301282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:29.331778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11eb52-44a0-4a56-8711-3d27ce736799 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:29.335442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:29.336048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:29.336329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:29.336602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:29.346089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:29.347504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:29.356933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1016/2040] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:29.622016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:29.627831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:29.653552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcc171-4ae6-42e5-a96b-c819cc56d26d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:29.673821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:29.675205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:29.675679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:29.676210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] PATH_INFO: `/v3/projects/f76ca801487a46bf8b6047bc17d3c60a` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:29.679927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76ca801487a46bf8b6047bc17d3c60a)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:29.682721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:29.722728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:29.748050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76ca801487a46bf8b6047bc17d3c60a', 'request_id': 'req-da104b99-0a1b-4b44-82c8-bb17ef5684b9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.757081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76ca801487a46bf8b6047bc17d3c60a', 'request_id': 'req-da104b99-0a1b-4b44-82c8-bb17ef5684b9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.763978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76ca801487a46bf8b6047bc17d3c60a', 'request_id': 'req-da104b99-0a1b-4b44-82c8-bb17ef5684b9'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.784709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] The token cache is being invalidate because project f76ca801487a46bf8b6047bc17d3c60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:29.785088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.786278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.791399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1025/2041] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:29 2022] DELETE /identity/v3/projects/f76ca801487a46bf8b6047bc17d3c60a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:29.792250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:29.805291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84e89-2ecb-4e11-9c4c-fc708b9fb850 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:29.885365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:29.885978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:29.886261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:29.886539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] PATH_INFO: `/v3/users/b34f2297a42a419cbed5debd07738d65` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:29.891670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34f2297a42a419cbed5debd07738d65)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:29.893709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:29.952419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34f2297a42a419cbed5debd07738d65'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.953240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34f2297a42a419cbed5debd07738d65'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.961252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34f2297a42a419cbed5debd07738d65'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.970584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34f2297a42a419cbed5debd07738d65'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.988547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-cc883041-9785-46d5-837f-59a284241fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34f2297a42a419cbed5debd07738d65'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:29.994927 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1017/2042] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:29 2022] DELETE /identity/v3/users/b34f2297a42a419cbed5debd07738d65 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:30.311542 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:30.313739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:30.338342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104b99-0a1b-4b44-82c8-bb17ef5684b9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:30.413126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:30.413791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:30.414099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:30.414408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] PATH_INFO: `/v3/projects/ba00aa71a8224d978deeb7bfc5b4694e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:30.415611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba00aa71a8224d978deeb7bfc5b4694e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:30.417532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:30.471659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba00aa71a8224d978deeb7bfc5b4694e', 'request_id': 'req-bca83593-852c-443a-8963-18ae2f5db94d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:30.479734 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba00aa71a8224d978deeb7bfc5b4694e', 'request_id': 'req-bca83593-852c-443a-8963-18ae2f5db94d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:30.486020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba00aa71a8224d978deeb7bfc5b4694e', 'request_id': 'req-bca83593-852c-443a-8963-18ae2f5db94d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:30.501391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] The token cache is being invalidate because project ba00aa71a8224d978deeb7bfc5b4694e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:30.501581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:30.502320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-bca83593-852c-443a-8963-18ae2f5db94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:30.504403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1026/2043] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:30 2022] DELETE /identity/v3/projects/ba00aa71a8224d978deeb7bfc5b4694e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:30.510118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27805-d5e3-40f3-8ddf-535fbdf6a1c1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:30.510634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27805-d5e3-40f3-8ddf-535fbdf6a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:30.510742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27805-d5e3-40f3-8ddf-535fbdf6a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:30.537811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-67e27805-d5e3-40f3-8ddf-535fbdf6a1c1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:30.539036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-67e27805-d5e3-40f3-8ddf-535fbdf6a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:30.608530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:30.632245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1018/2044] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:30.640976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54cf3-767b-4e32-ad6e-5b2503ba3005 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:30.641147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54cf3-767b-4e32-ad6e-5b2503ba3005 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:30.641432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb54cf3-767b-4e32-ad6e-5b2503ba3005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:30.679648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fcb54cf3-767b-4e32-ad6e-5b2503ba3005 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:30.680980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fcb54cf3-767b-4e32-ad6e-5b2503ba3005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:30.690921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1027/2045] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:30.695262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e27805-d5e3-40f3-8ddf-535fbdf6a1c1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:30.731023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e27805-d5e3-40f3-8ddf-535fbdf6a1c1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:30.739411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:30.740336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:30.740952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:30.741398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:30.743853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:30.744177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:30.746814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:30.769390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1019/2046] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:30:30.772198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb54cf3-767b-4e32-ad6e-5b2503ba3005 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:30.783831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb54cf3-767b-4e32-ad6e-5b2503ba3005 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:30.793094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:30.794769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:30.795240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:30.798059 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:30.801133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:30.803303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:30.846874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1028/2047] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:30 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:30.850924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:30.870608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a095b3-2ad1-429b-ae40-214d4a562efa admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:30.955674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:30.957551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:30.957702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:30.958002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:30.958656 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:30.960720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:30.988740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1020/2048] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:30 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:30.994678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.016902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc15af-1337-4334-86e1-886e2ba2aad6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.022095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.022799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.023172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.023519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.024243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.026025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.037856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1029/2049] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:30:31.041864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.054135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d7e9-91a9-49da-a33b-452da473430f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.059431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de78d3-da68-4d63-8d7d-e3000561055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.060054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de78d3-da68-4d63-8d7d-e3000561055c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.060337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de78d3-da68-4d63-8d7d-e3000561055c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.060612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de78d3-da68-4d63-8d7d-e3000561055c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.061282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de78d3-da68-4d63-8d7d-e3000561055c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.062979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de78d3-da68-4d63-8d7d-e3000561055c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.076002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1021/2050] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:31.080189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.087238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:31.093915 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1194c-f190-493a-8642-fc201a619b51 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.101442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.102127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.102740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.103330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] PATH_INFO: `/v3/projects/757381b326e24002ab30d1c84e4a0d91/users/f161c6dd08124dc496bec696ce86e361/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.127041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=757381b326e24002ab30d1c84e4a0d91, user_id=f161c6dd08124dc496bec696ce86e361, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.130265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.149157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1030/2051] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:31 2022] PUT /identity/v3/projects/757381b326e24002ab30d1c84e4a0d91/users/f161c6dd08124dc496bec696ce86e361/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:31.160387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6278e-0fe5-414e-8b26-01b9e4c65c77 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.160926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6278e-0fe5-414e-8b26-01b9e4c65c77 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.161206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6278e-0fe5-414e-8b26-01b9e4c65c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.210963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-89b6278e-0fe5-414e-8b26-01b9e4c65c77 None None] MFA Rules not processed for user `f161c6dd08124dc496bec696ce86e361`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:31.213302 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-89b6278e-0fe5-414e-8b26-01b9e4c65c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:31.309555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1022/2052] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:31.315049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.415605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7275f33-7f9c-410b-b5b7-6beb0e34bc56 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.423873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.424980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.425279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.425589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.426507 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.428710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.464836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1031/2053] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:31 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:31.469340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6278e-0fe5-414e-8b26-01b9e4c65c77 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.482223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6278e-0fe5-414e-8b26-01b9e4c65c77 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.532515 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:31.554651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.555460 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.555813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.556231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.556969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.559865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.587628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1023/2054] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:31 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:31.588890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.600942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2007b07-0d6a-42db-a35b-8591aba7e5a5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.605812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.606464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.606747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.607010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.607718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.609361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.622429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1032/2055] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:31.627037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.640230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a715-d2ed-44b4-9fcf-d1425ec93b25 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.645548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.646267 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.646518 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.646809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] PATH_INFO: `/v3/projects/9d5df4499acd4167ab3ef0e79d2b1836/users/cc7fafe44fc547cfaf7a22c93cb5bde7/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.665139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5df4499acd4167ab3ef0e79d2b1836, user_id=cc7fafe44fc547cfaf7a22c93cb5bde7, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.668037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.686933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1024/2056] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:31 2022] PUT /identity/v3/projects/9d5df4499acd4167ab3ef0e79d2b1836/users/cc7fafe44fc547cfaf7a22c93cb5bde7/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:31.691243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.702933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fa3d6-d9fc-43ed-bf07-9d37577fdac6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.771270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae35cb4-fff4-497a-9dd9-5d7c868447e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.771997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae35cb4-fff4-497a-9dd9-5d7c868447e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.772333 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae35cb4-fff4-497a-9dd9-5d7c868447e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.772684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae35cb4-fff4-497a-9dd9-5d7c868447e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.773416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae35cb4-fff4-497a-9dd9-5d7c868447e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.775130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae35cb4-fff4-497a-9dd9-5d7c868447e7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.788619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1033/2057] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:31.789837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.806055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae371f5d-0024-4ac5-a5cc-5fba0f49e0e1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:31.813654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:31.814604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.814935 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.815250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] PATH_INFO: `/v3/projects/9d5df4499acd4167ab3ef0e79d2b1836/users/cc7fafe44fc547cfaf7a22c93cb5bde7/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.817391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5df4499acd4167ab3ef0e79d2b1836, user_id=cc7fafe44fc547cfaf7a22c93cb5bde7, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:31.820325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:31.835123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1025/2058] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:31 2022] PUT /identity/v3/projects/9d5df4499acd4167ab3ef0e79d2b1836/users/cc7fafe44fc547cfaf7a22c93cb5bde7/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:31.843325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86191d-d4d5-47ea-9e9d-2da84e5fd7ae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:31.843614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86191d-d4d5-47ea-9e9d-2da84e5fd7ae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:31.843892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86191d-d4d5-47ea-9e9d-2da84e5fd7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:31.878930 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-2f86191d-d4d5-47ea-9e9d-2da84e5fd7ae None None] MFA Rules not processed for user `cc7fafe44fc547cfaf7a22c93cb5bde7`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:31.880368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2f86191d-d4d5-47ea-9e9d-2da84e5fd7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:31.932510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:31.962062 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1034/2059] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:31.974918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:31.977021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:32.039382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7693-ced0-4354-bae4-852d664ce98d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:32.043109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:32.044272 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:32.044549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:32.044819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:32.054184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:32.055748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:32.065771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1026/2060] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:32.422879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86191d-d4d5-47ea-9e9d-2da84e5fd7ae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:32.434298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86191d-d4d5-47ea-9e9d-2da84e5fd7ae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:32.441779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7fafe44fc547cfaf7a22c93cb5bde7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5df4499acd4167ab3ef0e79d2b1836', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:32.442396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:32.442901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:32.443416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:32.444087 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:32.444398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:32.446195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:32.462246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1035/2061] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:30:32.466546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:32.476753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458a3d-ae93-4721-90dd-556c66cd9e12 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:32.485125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7fafe44fc547cfaf7a22c93cb5bde7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5df4499acd4167ab3ef0e79d2b1836', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:32.485891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:32.486201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:32.486525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:32.488483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:32.490577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:32.531024 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1027/2062] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:32 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:32.536790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:32.550578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68dae-b2b1-4739-9620-20c0d3be213a tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:32.617331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7fafe44fc547cfaf7a22c93cb5bde7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5df4499acd4167ab3ef0e79d2b1836', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:32.619353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:32.619771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:32.620063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:32.621078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:32.621800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:32.623624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:32.637605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1036/2063] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:30:32.681884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:32.692953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca9251-d2b2-4fb8-9ad8-270203c14bc3 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:32.697949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7fafe44fc547cfaf7a22c93cb5bde7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5df4499acd4167ab3ef0e79d2b1836', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:32.698669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:32.699013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:32.699417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] PATH_INFO: `/v3/projects/d37e3b91da3e415caf1b2257c640ef5a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:32.700769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d37e3b91da3e415caf1b2257c640ef5a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:32.702737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:32.757091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37e3b91da3e415caf1b2257c640ef5a', 'request_id': 'req-07fbc147-095c-4aa2-8286-437648658645'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:32.766712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37e3b91da3e415caf1b2257c640ef5a', 'request_id': 'req-07fbc147-095c-4aa2-8286-437648658645'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:32.775249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37e3b91da3e415caf1b2257c640ef5a', 'request_id': 'req-07fbc147-095c-4aa2-8286-437648658645'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:32.782666 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:32.788942 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] The token cache is being invalidate because project d37e3b91da3e415caf1b2257c640ef5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:32.789265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:32.789979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-07fbc147-095c-4aa2-8286-437648658645 tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:32.795125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1028/2064] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:32 2022] DELETE /identity/v3/projects/d37e3b91da3e415caf1b2257c640ef5a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:33.037688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:33.039769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:33.123962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dcdb5-1904-4450-9075-cd0250dc176b tempest-VolumeQuotaClassesTest-503716548 tempest-VolumeQuotaClassesTest-503716548-project-admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:33.194055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:33.194789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:33.195174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:33.195516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] PATH_INFO: `/v3/users/f161c6dd08124dc496bec696ce86e361` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:33.196909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f161c6dd08124dc496bec696ce86e361)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:33.198887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:33.204738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:33.253263 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f161c6dd08124dc496bec696ce86e361'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.253952 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f161c6dd08124dc496bec696ce86e361'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.262321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f161c6dd08124dc496bec696ce86e361'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.275681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f161c6dd08124dc496bec696ce86e361'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.276411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f161c6dd08124dc496bec696ce86e361'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.289714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1037/2065] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:33 2022] DELETE /identity/v3/users/f161c6dd08124dc496bec696ce86e361 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:33.294994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:33.295396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:33.295679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:33.316753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:33.317952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:33.379694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1029/2066] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:33.389270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:33.390673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:33.450530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed11dd-a775-4ec4-92f8-7f19b01fcefb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:33.454641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:33.455283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:33.455595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:33.455874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:33.466817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:33.468322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:33.478119 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1038/2067] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:33.770244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:33.771954 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:33.784746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fbad1-070b-410f-8ebe-2d8a0f618d66 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:33.791335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:33.792476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:33.792476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:33.792658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] PATH_INFO: `/v3/projects/757381b326e24002ab30d1c84e4a0d91` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:33.796003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=757381b326e24002ab30d1c84e4a0d91)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:33.797906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:33.851662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757381b326e24002ab30d1c84e4a0d91', 'request_id': 'req-fee92e09-b577-40bc-8826-378dce9490d2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.858778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757381b326e24002ab30d1c84e4a0d91', 'request_id': 'req-fee92e09-b577-40bc-8826-378dce9490d2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.866316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757381b326e24002ab30d1c84e4a0d91', 'request_id': 'req-fee92e09-b577-40bc-8826-378dce9490d2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.878564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] The token cache is being invalidate because project 757381b326e24002ab30d1c84e4a0d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:33.878854 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.879513 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:33.881417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1030/2068] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:33 2022] DELETE /identity/v3/projects/757381b326e24002ab30d1c84e4a0d91 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:33.885325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:33.895755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510afe40-732e-4535-bc4e-a758b27ba96e service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:33.955726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:33.956397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:33.956681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:33.956957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] PATH_INFO: `/v3/users/cc7fafe44fc547cfaf7a22c93cb5bde7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:33.958097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7fafe44fc547cfaf7a22c93cb5bde7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:33.960072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:33.990972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:34.012370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7fafe44fc547cfaf7a22c93cb5bde7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.013061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7fafe44fc547cfaf7a22c93cb5bde7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.020519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7fafe44fc547cfaf7a22c93cb5bde7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.033663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7fafe44fc547cfaf7a22c93cb5bde7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.034368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8c5125cd-8b14-4c04-bfe8-dd775c43346f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7fafe44fc547cfaf7a22c93cb5bde7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.047627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1039/2069] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:33 2022] DELETE /identity/v3/users/cc7fafe44fc547cfaf7a22c93cb5bde7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:34.377491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:34.379646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:34.396766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92e09-b577-40bc-8826-378dce9490d2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:34.467603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:34.468271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.468551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.468821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] PATH_INFO: `/v3/projects/9d5df4499acd4167ab3ef0e79d2b1836` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.469952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5df4499acd4167ab3ef0e79d2b1836)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:34.471920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:34.498002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:34.522409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5df4499acd4167ab3ef0e79d2b1836', 'request_id': 'req-d770e0a1-280b-499e-a7d9-f84792a73ab5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.537058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5df4499acd4167ab3ef0e79d2b1836', 'request_id': 'req-d770e0a1-280b-499e-a7d9-f84792a73ab5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.545845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5df4499acd4167ab3ef0e79d2b1836', 'request_id': 'req-d770e0a1-280b-499e-a7d9-f84792a73ab5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.557226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] The token cache is being invalidate because project 9d5df4499acd4167ab3ef0e79d2b1836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:34.557524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.558217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d770e0a1-280b-499e-a7d9-f84792a73ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:34.560467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1031/2070] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:34 2022] DELETE /identity/v3/projects/9d5df4499acd4167ab3ef0e79d2b1836 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:34.565569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2e199-3393-412a-909f-ee8974143c5b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.566047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2e199-3393-412a-909f-ee8974143c5b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.566159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2e199-3393-412a-909f-ee8974143c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.586453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f5e2e199-3393-412a-909f-ee8974143c5b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:34.587676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f5e2e199-3393-412a-909f-ee8974143c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:34.653863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1040/2071] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:30:34.661699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25359b-87a1-453f-a50e-6c3c65716cc0 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.661990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25359b-87a1-453f-a50e-6c3c65716cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.662270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25359b-87a1-453f-a50e-6c3c65716cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.684680 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-1a25359b-87a1-453f-a50e-6c3c65716cc0 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:34.686001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1a25359b-87a1-453f-a50e-6c3c65716cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:34.694181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1032/2072] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:34.698481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2e199-3393-412a-909f-ee8974143c5b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:34.711252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2e199-3393-412a-909f-ee8974143c5b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:34.716236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:34.716859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.717141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.717418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.718075 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:34.718383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:34.720152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:34.732700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1041/2073] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:30:34.737145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25359b-87a1-453f-a50e-6c3c65716cc0 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:34.748029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25359b-87a1-453f-a50e-6c3c65716cc0 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:34.752908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:34.753671 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.753928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.754198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.754832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:34.756811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:34.785035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1033/2074] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:34 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:34.789188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:34.800312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ff8b4-af9b-445c-870c-1eceba359ef2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:34.861327 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:34.861938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.862213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.862486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.863202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:34.865151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:34.888138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1042/2075] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:34 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:34.892267 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:34.903428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ab2d8-69d0-4030-843b-21d9f1c466b8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:34.908456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:34.909013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.909297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.909575 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.910381 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:34.912154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:34.923744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1034/2076] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:34.927647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:34.937764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9182ecd-b9b7-42b0-b0b3-c9e50d54eed7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:34.942790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f502a5-24e4-4e5a-a528-ac064140a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:34.943192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f502a5-24e4-4e5a-a528-ac064140a1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.943481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f502a5-24e4-4e5a-a528-ac064140a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.943759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f502a5-24e4-4e5a-a528-ac064140a1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.944414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f502a5-24e4-4e5a-a528-ac064140a1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:34.946020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f502a5-24e4-4e5a-a528-ac064140a1c6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:34.958940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1043/2077] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:34.962968 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:34.974026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4da35-e8f5-404f-bda6-a06842d5438c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:34.979105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:34.979778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:34.980061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:34.980345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] PATH_INFO: `/v3/projects/a9ee9b43623e44bfb8776d330fc849b7/users/08ea961d759f4c40be16a62359580f52/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:34.997059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ee9b43623e44bfb8776d330fc849b7, user_id=08ea961d759f4c40be16a62359580f52, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:34.999799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:35.014185 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1035/2078] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:34 2022] PUT /identity/v3/projects/a9ee9b43623e44bfb8776d330fc849b7/users/08ea961d759f4c40be16a62359580f52/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:35.025595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71c393-c6c0-4f62-8553-911af47fcc84 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:35.025881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71c393-c6c0-4f62-8553-911af47fcc84 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:35.026156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71c393-c6c0-4f62-8553-911af47fcc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:35.047638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:35.056441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9d71c393-c6c0-4f62-8553-911af47fcc84 None None] MFA Rules not processed for user `08ea961d759f4c40be16a62359580f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:35.058307 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9d71c393-c6c0-4f62-8553-911af47fcc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:35.126104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1044/2079] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:35.138052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:35.139843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:35.204008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dda78d-09b1-488c-97cf-91046e9fe526 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:35.207984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf5c36-b972-4e43-83fc-0966f742dab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:35.208604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf5c36-b972-4e43-83fc-0966f742dab8 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:35.208892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf5c36-b972-4e43-83fc-0966f742dab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:35.209166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf5c36-b972-4e43-83fc-0966f742dab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:35.218034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf5c36-b972-4e43-83fc-0966f742dab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:35.219601 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf5c36-b972-4e43-83fc-0966f742dab8 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:35.228958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1036/2080] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:35.248339 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71c393-c6c0-4f62-8553-911af47fcc84 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:35.326133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71c393-c6c0-4f62-8553-911af47fcc84 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:35.332267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:35.333135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:35.333393 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:35.337318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] PATH_INFO: `/v3/users/08ea961d759f4c40be16a62359580f52` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:35.340568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ea961d759f4c40be16a62359580f52)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:35.342969 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:35.405834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ea961d759f4c40be16a62359580f52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:35.406602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ea961d759f4c40be16a62359580f52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:35.414408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ea961d759f4c40be16a62359580f52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:35.429275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ea961d759f4c40be16a62359580f52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:35.430103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ea961d759f4c40be16a62359580f52'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:35.451630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1045/2081] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:35 2022] DELETE /identity/v3/users/08ea961d759f4c40be16a62359580f52 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:35.453305 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:35.453928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:35.454254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:35.479517 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:35.481778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:35.539447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:35.557076 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1037/2082] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:35.567846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:35.569386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:35.593347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:35.637041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0203f6-23c5-434b-83fa-9f3ed4d912e9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:35.641261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fc1fb-f21e-4cb8-abd6-8ddb427adc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:35.641867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fc1fb-f21e-4cb8-abd6-8ddb427adc8d service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:35.642154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fc1fb-f21e-4cb8-abd6-8ddb427adc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:35.642426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fc1fb-f21e-4cb8-abd6-8ddb427adc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:35.653737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fc1fb-f21e-4cb8-abd6-8ddb427adc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:35.655488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fc1fb-f21e-4cb8-abd6-8ddb427adc8d service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:35.666198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1046/2083] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:35.946949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:35.948088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:35.962010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5158b-b268-4e25-9448-bea505d61da3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:35.967448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:35.968345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:35.968723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:35.969094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] PATH_INFO: `/v3/projects/a9ee9b43623e44bfb8776d330fc849b7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:35.970425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ee9b43623e44bfb8776d330fc849b7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:35.972842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.028857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ee9b43623e44bfb8776d330fc849b7', 'request_id': 'req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.035375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ee9b43623e44bfb8776d330fc849b7', 'request_id': 'req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.043968 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ee9b43623e44bfb8776d330fc849b7', 'request_id': 'req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.055183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] The token cache is being invalidate because project a9ee9b43623e44bfb8776d330fc849b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:36.055701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.056364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-542d8ef1-1c88-4e0c-8436-c32d78f2dce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.057885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1038/2084] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:35 2022] DELETE /identity/v3/projects/a9ee9b43623e44bfb8776d330fc849b7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:36.063345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd13e-aa81-41a4-a55a-c709f07f3c02 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.063630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd13e-aa81-41a4-a55a-c709f07f3c02 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.063907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd13e-aa81-41a4-a55a-c709f07f3c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.084283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-060dd13e-aa81-41a4-a55a-c709f07f3c02 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:36.085473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-060dd13e-aa81-41a4-a55a-c709f07f3c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:36.146057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1047/2085] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:36.153760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d0802-8499-4e39-99f1-c8cf4445be4c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.154047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d0802-8499-4e39-99f1-c8cf4445be4c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.154321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d0802-8499-4e39-99f1-c8cf4445be4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.176061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-138d0802-8499-4e39-99f1-c8cf4445be4c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:36.177321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-138d0802-8499-4e39-99f1-c8cf4445be4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:36.190990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dd13e-aa81-41a4-a55a-c709f07f3c02 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.191562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1039/2086] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:30:36.201041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dd13e-aa81-41a4-a55a-c709f07f3c02 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.205831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.206432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.206709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.206981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.207662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:36.207993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.209584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.221495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1048/2087] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:30:36.226073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d0802-8499-4e39-99f1-c8cf4445be4c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.236661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d0802-8499-4e39-99f1-c8cf4445be4c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.241719 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.242319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.242727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.243002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.243705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.245630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.274091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1040/2088] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:36 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:30:36.278466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.288631 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94f204-bf7f-4a14-afc6-da53186155e3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.348933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.349551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.349832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.350224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.350879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.352932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.376821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1049/2089] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:36 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:36.380775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.391846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9e713-2b97-4667-af56-0a0a99d39d85 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.396571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.397268 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.397545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.397816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.398461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.400136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.411244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1041/2090] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:36.415583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.426753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c4381-5da1-4e51-83ff-8f7a3f16f98d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.431662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b535e-0b3e-4bc0-9b85-7d7b19ff012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.432453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b535e-0b3e-4bc0-9b85-7d7b19ff012d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.432735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b535e-0b3e-4bc0-9b85-7d7b19ff012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.433011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b535e-0b3e-4bc0-9b85-7d7b19ff012d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.433687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b535e-0b3e-4bc0-9b85-7d7b19ff012d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.435365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b535e-0b3e-4bc0-9b85-7d7b19ff012d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.446387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1050/2091] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:36.450841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.461524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5f959-fd42-4000-905f-d877d937c1aa admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.466992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.467786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.468132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.468469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] PATH_INFO: `/v3/projects/7e1ec7ace64e4b578e02131dd2a9f081/users/567140e8670e453e918eed5e7451c387/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.484675 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1ec7ace64e4b578e02131dd2a9f081, user_id=567140e8670e453e918eed5e7451c387, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.487496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.502426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1042/2092] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:36 2022] PUT /identity/v3/projects/7e1ec7ace64e4b578e02131dd2a9f081/users/567140e8670e453e918eed5e7451c387/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:36.513391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.514436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.514816 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.551334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] MFA Rules not processed for user `567140e8670e453e918eed5e7451c387`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:36.552932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:36.571932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:36.633686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.635177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1051/2093] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:36.636139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:36.648438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.649974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:36.706099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd802fc2-9165-4bef-8adf-598804e6a35b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.710194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699a10-97c6-4b1d-8310-298351a287ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.710815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699a10-97c6-4b1d-8310-298351a287ef service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.711159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699a10-97c6-4b1d-8310-298351a287ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.711437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699a10-97c6-4b1d-8310-298351a287ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.713532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-33699a10-97c6-4b1d-8310-298351a287ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:36.717355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b02aa-df16-4978-9456-7032d51ceaaf None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.721726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.722363 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.722648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.722933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.733894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.735836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.743524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:36.748271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1052/2094] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:30:36.776253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:36.786550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699a10-97c6-4b1d-8310-298351a287ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.787597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48a09f-fb56-43cb-9528-3e0ece61bf17 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:36.788172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699a10-97c6-4b1d-8310-298351a287ef service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.792833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:36.793932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.794213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.795220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] PATH_INFO: `/v3/users/567140e8670e453e918eed5e7451c387` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.796073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567140e8670e453e918eed5e7451c387)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:36.798207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:36.800594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1043/2095] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:36.851454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567140e8670e453e918eed5e7451c387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.852265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567140e8670e453e918eed5e7451c387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.860482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567140e8670e453e918eed5e7451c387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.874251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567140e8670e453e918eed5e7451c387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.874993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567140e8670e453e918eed5e7451c387'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:36.892812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1053/2096] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:36 2022] DELETE /identity/v3/users/567140e8670e453e918eed5e7451c387 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:36.894308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:36.894595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:36.894872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:36.920198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:36.921443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:36.989251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1044/2097] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:36.998635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:37.000301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:37.038590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:37.069256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0e73-f2a6-417c-883f-284286682bb8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:37.073205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42caac-cee4-41a3-8510-e8f187e684c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:37.073917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42caac-cee4-41a3-8510-e8f187e684c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:37.074293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42caac-cee4-41a3-8510-e8f187e684c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:37.074635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42caac-cee4-41a3-8510-e8f187e684c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:37.084641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42caac-cee4-41a3-8510-e8f187e684c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:37.086107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42caac-cee4-41a3-8510-e8f187e684c2 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:37.097552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1054/2098] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:37.546763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:37.548756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:37.571202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42281db8-2c2f-4959-9636-3f8c1e9acacc None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:37.581071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:37.582462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:37.583528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:37.583823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] PATH_INFO: `/v3/projects/7e1ec7ace64e4b578e02131dd2a9f081` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:37.586303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1ec7ace64e4b578e02131dd2a9f081)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:37.590950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:37.649936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1ec7ace64e4b578e02131dd2a9f081', 'request_id': 'req-d9e00af7-cdcb-47fe-a6ba-a38901c737df'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:37.657547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1ec7ace64e4b578e02131dd2a9f081', 'request_id': 'req-d9e00af7-cdcb-47fe-a6ba-a38901c737df'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:37.666915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1ec7ace64e4b578e02131dd2a9f081', 'request_id': 'req-d9e00af7-cdcb-47fe-a6ba-a38901c737df'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:37.682427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] The token cache is being invalidate because project 7e1ec7ace64e4b578e02131dd2a9f081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:37.683016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:37.684520 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d9e00af7-cdcb-47fe-a6ba-a38901c737df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:37.686545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1045/2099] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:37 2022] DELETE /identity/v3/projects/7e1ec7ace64e4b578e02131dd2a9f081 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:37.691687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0186-521b-4a14-91e0-17611437c7d8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:37.692187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0186-521b-4a14-91e0-17611437c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:37.692300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0186-521b-4a14-91e0-17611437c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:37.731999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-41cd0186-521b-4a14-91e0-17611437c7d8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:37.733235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-41cd0186-521b-4a14-91e0-17611437c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:37.809982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1055/2100] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:37.819195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253833-4a9c-4c70-b7ee-91de84e6c7af None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:37.819508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253833-4a9c-4c70-b7ee-91de84e6c7af None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:37.819779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253833-4a9c-4c70-b7ee-91de84e6c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:37.842157 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8f253833-4a9c-4c70-b7ee-91de84e6c7af None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:37.843641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8f253833-4a9c-4c70-b7ee-91de84e6c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:37.855231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1046/2101] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:37.857077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0186-521b-4a14-91e0-17611437c7d8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:37.867510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0186-521b-4a14-91e0-17611437c7d8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:37.876976 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:37.877608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:37.877893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:37.878170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:37.878827 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:37.879166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:37.880781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:37.896294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1056/2102] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:30:37.897856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f253833-4a9c-4c70-b7ee-91de84e6c7af None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:37.911326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f253833-4a9c-4c70-b7ee-91de84e6c7af None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:37.916218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:37.916915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:37.917340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:37.917664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:37.918956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:37.920994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:37.952077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1047/2103] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:37 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:37.956093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:37.966929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24453-83d5-4f12-b80f-368a49c34c42 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:38.038703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:38.039505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:38.039781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:38.040159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:38.040822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:38.044420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:38.080367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1057/2104] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:37 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:30:38.085430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:38.105299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9815c4-6cca-4eaf-b076-aa535ba83f09 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:38.111917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:38.112556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:38.113258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:38.113530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:38.114395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:38.116065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:38.148406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1048/2105] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:38.151640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:38.169967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2235e3-142f-482f-ab08-af51afe1ddd9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:38.188573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e212c-e6fb-4d05-ad3b-9a49e51c6a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:38.189213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e212c-e6fb-4d05-ad3b-9a49e51c6a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:38.189501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e212c-e6fb-4d05-ad3b-9a49e51c6a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:38.189778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e212c-e6fb-4d05-ad3b-9a49e51c6a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:38.190441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e212c-e6fb-4d05-ad3b-9a49e51c6a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:38.192236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e212c-e6fb-4d05-ad3b-9a49e51c6a95 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:38.208457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1058/2106] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:30:38.210114 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:38.225336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab05b-512d-49de-9d62-4c607a1a4221 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:38.226587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:38.234183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:38.235593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:38.236929 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:38.237478 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] PATH_INFO: `/v3/projects/92af470f770c4dfbb8a7dfec4e111561/users/a96053a1cdd94b498cc214b7939f5356/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:38.263792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92af470f770c4dfbb8a7dfec4e111561, user_id=a96053a1cdd94b498cc214b7939f5356, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:38.279170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:38.320533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1049/2107] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:38 2022] PUT /identity/v3/projects/92af470f770c4dfbb8a7dfec4e111561/users/a96053a1cdd94b498cc214b7939f5356/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:38.381143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cedd07-7b99-4e3f-9e1f-4ee9eb02753c None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:38.381703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cedd07-7b99-4e3f-9e1f-4ee9eb02753c None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:38.381986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cedd07-7b99-4e3f-9e1f-4ee9eb02753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:38.417081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-00cedd07-7b99-4e3f-9e1f-4ee9eb02753c None None] MFA Rules not processed for user `a96053a1cdd94b498cc214b7939f5356`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:38.419098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-00cedd07-7b99-4e3f-9e1f-4ee9eb02753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:38.465673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:38.538765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1059/2108] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:38.563122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:38.565551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:38.723621 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869917b-f78b-448a-9773-28d5750292d5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:38.738874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf650-6708-47e1-a0a9-8eba8fffc72f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:38.741894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf650-6708-47e1-a0a9-8eba8fffc72f service glance] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:38.742044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf650-6708-47e1-a0a9-8eba8fffc72f service glance] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:38.742463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf650-6708-47e1-a0a9-8eba8fffc72f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:38.764963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbf650-6708-47e1-a0a9-8eba8fffc72f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:38.779447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbf650-6708-47e1-a0a9-8eba8fffc72f service glance] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:38.824672 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1050/2109] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:40.581675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492acb3-2cba-4a20-aac9-d98b1fa33aec None None] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:40.582128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492acb3-2cba-4a20-aac9-d98b1fa33aec None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:40.582296 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492acb3-2cba-4a20-aac9-d98b1fa33aec None None] PATH_INFO: `/` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:40.587235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1060/2110] 10.222.0.46 () {54 vars in 921 bytes} [Wed Oct 19 13:30:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 19 13:30:40.609722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:40.610571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:40.611033 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:40.641516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] MFA Rules not processed for user `c1b620598f694d4bae6a96822fc7e843`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:40.643249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:40.651115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492acb3-2cba-4a20-aac9-d98b1fa33aec None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:40.655176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f492acb3-2cba-4a20-aac9-d98b1fa33aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:40.721952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1051/2111] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Oct 19 13:30:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:40.734447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:40.735810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:40.736975 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492acb3-2cba-4a20-aac9-d98b1fa33aec None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:40.743380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:40.744014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:40.744291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:40.744563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] PATH_INFO: `/v3/users/30c408bc33b84cadb1b16ac2327011d4` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:40.745704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c408bc33b84cadb1b16ac2327011d4)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:40.748242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:40.749580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678cc4-85c1-40d5-b15d-4b62de585759 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:40.754864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:40.755431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:40.755712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:40.755985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:40.765197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:40.766823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:40.776693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1052/2112] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:30:40.805498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c408bc33b84cadb1b16ac2327011d4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:40.806392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c408bc33b84cadb1b16ac2327011d4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:40.816997 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c408bc33b84cadb1b16ac2327011d4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:40.829425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c408bc33b84cadb1b16ac2327011d4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:40.830153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6a8359af-6533-40ea-ba1c-af1d0a5f6171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c408bc33b84cadb1b16ac2327011d4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:40.842697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1061/2113] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:40 2022] DELETE /identity/v3/users/30c408bc33b84cadb1b16ac2327011d4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:41.025925 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.038660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffb01d-ca65-43a4-bae4-74da17b0f4a0 service placement] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.100716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.101373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.101663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.101946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] PATH_INFO: `/v3/projects/d777a906e5fb45869e62ea130cc98c99` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.103176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d777a906e5fb45869e62ea130cc98c99)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.105116 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.114189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:41.152842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd777a906e5fb45869e62ea130cc98c99', 'request_id': 'req-9444fdfa-1915-42b0-839b-5dd9c6851462'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:41.159391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd777a906e5fb45869e62ea130cc98c99', 'request_id': 'req-9444fdfa-1915-42b0-839b-5dd9c6851462'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:41.167633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd777a906e5fb45869e62ea130cc98c99', 'request_id': 'req-9444fdfa-1915-42b0-839b-5dd9c6851462'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:41.179403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] The token cache is being invalidate because project d777a906e5fb45869e62ea130cc98c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:41.181333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:41.182140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9444fdfa-1915-42b0-839b-5dd9c6851462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:41.183894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1053/2114] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:41 2022] DELETE /identity/v3/projects/d777a906e5fb45869e62ea130cc98c99 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:41.188803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3afd7-62ee-4189-86e5-8e9bf593e249 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.189126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3afd7-62ee-4189-86e5-8e9bf593e249 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.189372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3afd7-62ee-4189-86e5-8e9bf593e249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.208732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-d1a3afd7-62ee-4189-86e5-8e9bf593e249 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:41.209939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d1a3afd7-62ee-4189-86e5-8e9bf593e249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:41.256929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:41.273511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1062/2115] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:41.282257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0c26-af4e-47e1-90e4-b50b53288188 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.282545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0c26-af4e-47e1-90e4-b50b53288188 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.282821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0c26-af4e-47e1-90e4-b50b53288188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.303962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-114b0c26-af4e-47e1-90e4-b50b53288188 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:41.305212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-114b0c26-af4e-47e1-90e4-b50b53288188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:41.313147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1054/2116] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:41.317377 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3afd7-62ee-4189-86e5-8e9bf593e249 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.327596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3afd7-62ee-4189-86e5-8e9bf593e249 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.332217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.332847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.333128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.333400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.334061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:41.334369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.336039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.348789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1063/2117] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:30:41.353130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b0c26-af4e-47e1-90e4-b50b53288188 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.362466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b0c26-af4e-47e1-90e4-b50b53288188 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.367613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.368222 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.368506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.368781 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.369616 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.372062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.400468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1055/2118] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:41 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:41.405194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.415241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f2aee-f79f-4400-8d43-6ce94b3fd9f8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.472225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.472870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.473150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.473423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.474061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.476046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.497904 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1064/2119] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:41 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:41.502023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.512161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b881-deab-41f5-bbfa-72f397e71529 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.516916 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.517512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.517799 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.518072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.518773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.520514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.532104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1056/2120] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:41.535565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.545961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07400-01c4-498f-93b0-b410b0c4fd14 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.550781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41007f76-7a0b-406a-8ff7-99c6a241fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.551408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41007f76-7a0b-406a-8ff7-99c6a241fa9d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.551691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41007f76-7a0b-406a-8ff7-99c6a241fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.551967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41007f76-7a0b-406a-8ff7-99c6a241fa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.552674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41007f76-7a0b-406a-8ff7-99c6a241fa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.554293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41007f76-7a0b-406a-8ff7-99c6a241fa9d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.571097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1065/2121] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:41.573060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.584165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a607e-f789-4bb4-9749-c43e2873e448 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.589039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.589708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.590147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.590300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] PATH_INFO: `/v3/projects/13dd0788bd694bceb7bb32c970e04490/users/2f18a5775a674548a5351be1a8c988a5/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.606318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13dd0788bd694bceb7bb32c970e04490, user_id=2f18a5775a674548a5351be1a8c988a5, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.609559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.623162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1057/2122] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:41 2022] PUT /identity/v3/projects/13dd0788bd694bceb7bb32c970e04490/users/2f18a5775a674548a5351be1a8c988a5/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:41.635858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d6dd5-f9d3-4029-bdf1-ae46c24cd982 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.636407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d6dd5-f9d3-4029-bdf1-ae46c24cd982 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.636521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d6dd5-f9d3-4029-bdf1-ae46c24cd982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.664347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1c5d6dd5-f9d3-4029-bdf1-ae46c24cd982 None None] MFA Rules not processed for user `2f18a5775a674548a5351be1a8c988a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:41.665600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1c5d6dd5-f9d3-4029-bdf1-ae46c24cd982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:41.732828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1066/2123] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:30:41.737318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.801400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d957d3-264c-4429-959c-c6030b40b3c8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.806061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.806706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.806989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.807294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.807944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.809884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.838984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1058/2124] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:41 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:41.841177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d6dd5-f9d3-4029-bdf1-ae46c24cd982 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.852154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d6dd5-f9d3-4029-bdf1-ae46c24cd982 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.898917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:41.913677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.914304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.914623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.914861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.915554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.917494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.938949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1067/2125] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:41 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:30:41.943010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.953686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30722e2b-d2dc-4b22-af0c-205d1787f95f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.958786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.959437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.959716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.959985 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:41.960640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:41.962264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:41.974840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1059/2126] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:41.979461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:41.990285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be9c55-10d2-4495-8a62-8a4296d33952 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:41.995221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:41.995885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:41.996166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:41.996447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] PATH_INFO: `/v3/projects/3f3ee1d897f647f9803649e4a54d763a/users/57d745777d1a42739902a3962aa4bcbe/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:42.011871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3ee1d897f647f9803649e4a54d763a, user_id=57d745777d1a42739902a3962aa4bcbe, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:42.015039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:42.029098 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1068/2127] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:41 2022] PUT /identity/v3/projects/3f3ee1d897f647f9803649e4a54d763a/users/57d745777d1a42739902a3962aa4bcbe/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:42.033040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:42.043007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a9b08-c905-42bc-a8ad-e90fbf52a874 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:42.046597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:42.104625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381343a9-1c21-4ca7-972d-c7b481126127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:42.105243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381343a9-1c21-4ca7-972d-c7b481126127 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:42.105528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381343a9-1c21-4ca7-972d-c7b481126127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:42.105803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381343a9-1c21-4ca7-972d-c7b481126127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:42.106453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381343a9-1c21-4ca7-972d-c7b481126127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:42.108089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381343a9-1c21-4ca7-972d-c7b481126127 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:42.118187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1060/2128] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:42.122328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:42.132627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034020ec-7c00-4e58-8e51-2936dbb65782 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:42.139942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:42.140611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:42.140892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:42.141167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] PATH_INFO: `/v3/projects/3f3ee1d897f647f9803649e4a54d763a/users/57d745777d1a42739902a3962aa4bcbe/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:42.143128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3ee1d897f647f9803649e4a54d763a, user_id=57d745777d1a42739902a3962aa4bcbe, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:42.145766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:42.156948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1069/2129] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:42 2022] PUT /identity/v3/projects/3f3ee1d897f647f9803649e4a54d763a/users/57d745777d1a42739902a3962aa4bcbe/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:42.167322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fee208-c5e4-4db5-a608-ee54c69ef9a1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:42.167608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fee208-c5e4-4db5-a608-ee54c69ef9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:42.167883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fee208-c5e4-4db5-a608-ee54c69ef9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:42.197699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-03fee208-c5e4-4db5-a608-ee54c69ef9a1 None None] MFA Rules not processed for user `57d745777d1a42739902a3962aa4bcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:42.198951 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-03fee208-c5e4-4db5-a608-ee54c69ef9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:42.279451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1061/2130] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:42.291107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:42.292870 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:42.351684 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340568b0-6cd6-45e8-b72f-9a9675df9796 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:42.355911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba648b-0055-4112-b0cd-62fe67ad089b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:42.356457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba648b-0055-4112-b0cd-62fe67ad089b service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:42.356743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba648b-0055-4112-b0cd-62fe67ad089b service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:42.357018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba648b-0055-4112-b0cd-62fe67ad089b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:42.366613 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba648b-0055-4112-b0cd-62fe67ad089b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:42.368074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba648b-0055-4112-b0cd-62fe67ad089b service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:42.378007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1070/2131] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:42.770406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fee208-c5e4-4db5-a608-ee54c69ef9a1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:42.833877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fee208-c5e4-4db5-a608-ee54c69ef9a1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:42.838554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:42.839219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:42.839549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:42.839828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] PATH_INFO: `/v3/users/2f18a5775a674548a5351be1a8c988a5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:42.841716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f18a5775a674548a5351be1a8c988a5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:42.843698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:42.878069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:42.892758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f18a5775a674548a5351be1a8c988a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:42.893454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f18a5775a674548a5351be1a8c988a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:42.900784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f18a5775a674548a5351be1a8c988a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:42.908016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f18a5775a674548a5351be1a8c988a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:42.920529 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f18a5775a674548a5351be1a8c988a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:42.926898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1062/2132] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:42 2022] DELETE /identity/v3/users/2f18a5775a674548a5351be1a8c988a5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:42.931387 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f522-219a-4554-b662-f682a46732ec None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:42.931885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f522-219a-4554-b662-f682a46732ec None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:42.931990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f522-219a-4554-b662-f682a46732ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:42.952737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0104f522-219a-4554-b662-f682a46732ec None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:42.953961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0104f522-219a-4554-b662-f682a46732ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:43.017718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1071/2133] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:43.027736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:43.029362 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:43.088111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d315016-f885-416f-8667-57f8a462fc00 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:43.092470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:43.093091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:43.093367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:43.093635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:43.103067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:43.104530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:43.114009 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1063/2134] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:43.384483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f522-219a-4554-b662-f682a46732ec None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:43.386030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0104f522-219a-4554-b662-f682a46732ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:43.398754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f522-219a-4554-b662-f682a46732ec None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:43.404890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:43.405643 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:43.405999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:43.406350 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] PATH_INFO: `/v3/projects/13dd0788bd694bceb7bb32c970e04490` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:43.407574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13dd0788bd694bceb7bb32c970e04490)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:43.409620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:43.452011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:43.461309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13dd0788bd694bceb7bb32c970e04490', 'request_id': 'req-c9972162-7d85-4b56-9a36-455b74aac048'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.468711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13dd0788bd694bceb7bb32c970e04490', 'request_id': 'req-c9972162-7d85-4b56-9a36-455b74aac048'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.475438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13dd0788bd694bceb7bb32c970e04490', 'request_id': 'req-c9972162-7d85-4b56-9a36-455b74aac048'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.488551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] The token cache is being invalidate because project 13dd0788bd694bceb7bb32c970e04490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:43.488843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.489458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.491063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1072/2135] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:43 2022] DELETE /identity/v3/projects/13dd0788bd694bceb7bb32c970e04490 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:43.495617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:43.506818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecef470-3771-42bc-97e4-9d96d72dbb5b service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:43.542233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:43.544229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:43.571822 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:43.572461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:43.572741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:43.573016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] PATH_INFO: `/v3/users/57d745777d1a42739902a3962aa4bcbe` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:43.574142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d745777d1a42739902a3962aa4bcbe)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:43.576117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:43.626904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d745777d1a42739902a3962aa4bcbe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.627186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9972162-7d85-4b56-9a36-455b74aac048 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:43.627606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d745777d1a42739902a3962aa4bcbe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.632137 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:43.632990 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5741-28ee-4c4e-862d-27de7c183277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:43.633838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5741-28ee-4c4e-862d-27de7c183277 service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:43.633999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5741-28ee-4c4e-862d-27de7c183277 service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:43.634262 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5741-28ee-4c4e-862d-27de7c183277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:43.635388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d745777d1a42739902a3962aa4bcbe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.636395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8c3a5741-28ee-4c4e-862d-27de7c183277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:43.649737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d745777d1a42739902a3962aa4bcbe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.663383 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d745777d1a42739902a3962aa4bcbe'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:43.669531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1064/2136] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:30:43 2022] DELETE /identity/v3/users/57d745777d1a42739902a3962aa4bcbe => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:43.711154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a5741-28ee-4c4e-862d-27de7c183277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:43.713905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a5741-28ee-4c4e-862d-27de7c183277 service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:43.727648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1073/2137] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:30:43.969444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:43.971036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:44.065623 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5f486-5608-4e32-9009-61dd10ec6593 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.071219 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.072214 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.072500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.072772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] PATH_INFO: `/v3/projects/3f3ee1d897f647f9803649e4a54d763a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.073975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3ee1d897f647f9803649e4a54d763a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.076481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.132865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3ee1d897f647f9803649e4a54d763a', 'request_id': 'req-817730ee-7989-4c50-9469-416fde829e72'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:44.140439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3ee1d897f647f9803649e4a54d763a', 'request_id': 'req-817730ee-7989-4c50-9469-416fde829e72'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:44.148104 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3ee1d897f647f9803649e4a54d763a', 'request_id': 'req-817730ee-7989-4c50-9469-416fde829e72'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:44.158532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] The token cache is being invalidate because project 3f3ee1d897f647f9803649e4a54d763a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:30:44.158803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:44.159436 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-817730ee-7989-4c50-9469-416fde829e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:30:44.160970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1065/2138] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:30:43 2022] DELETE /identity/v3/projects/3f3ee1d897f647f9803649e4a54d763a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:44.166242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17689942-d751-4fc0-b8c2-c7a315c8701e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.166756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17689942-d751-4fc0-b8c2-c7a315c8701e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.166872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17689942-d751-4fc0-b8c2-c7a315c8701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.187571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-17689942-d751-4fc0-b8c2-c7a315c8701e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:44.188766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-17689942-d751-4fc0-b8c2-c7a315c8701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:44.247872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1074/2139] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:44.255492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edd7bf-32d0-4c73-8401-854cd2e65d3e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.255782 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edd7bf-32d0-4c73-8401-854cd2e65d3e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.256062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edd7bf-32d0-4c73-8401-854cd2e65d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.276647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-01edd7bf-32d0-4c73-8401-854cd2e65d3e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:44.277869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-01edd7bf-32d0-4c73-8401-854cd2e65d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:44.285838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1066/2140] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:44.290177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17689942-d751-4fc0-b8c2-c7a315c8701e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.295536 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:44.302120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17689942-d751-4fc0-b8c2-c7a315c8701e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.307555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.308338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.308617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.308893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.310157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:30:44.310460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.312073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.324101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1075/2141] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:30:44.328704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edd7bf-32d0-4c73-8401-854cd2e65d3e None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.338142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edd7bf-32d0-4c73-8401-854cd2e65d3e None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.343960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.344797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.345079 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.347519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.348211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.350183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.379670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1067/2142] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:44 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:44.384016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.394748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc6cd4-a837-48e9-a281-c697932893ab admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.452877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.453490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.453772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.454048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.454690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.456653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.480989 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1076/2143] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:44 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:44.485704 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.496252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7946d-5bc4-41a9-adba-edad6ccb38d6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.501531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.502112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.502378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.502646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.503335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.504943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.515379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1068/2144] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:44.519554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.529757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c33b3-bbc3-4d1a-8718-9105a0f5ec97 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.534871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6e097-dc34-4a26-84e7-663071e4e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.535515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e097-dc34-4a26-84e7-663071e4e11c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.535801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e097-dc34-4a26-84e7-663071e4e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.536074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e097-dc34-4a26-84e7-663071e4e11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.536718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e097-dc34-4a26-84e7-663071e4e11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.538320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6e097-dc34-4a26-84e7-663071e4e11c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.550511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1077/2145] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:44.554713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.565547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fab516-4b86-4f64-95c1-f02a1d5407dd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.570183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.570829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.571180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.571462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] PATH_INFO: `/v3/projects/e0ae1cbe860f4d9d866ef1b1828c4677/users/df2bf0469890450797bc54849b365100/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.585774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ae1cbe860f4d9d866ef1b1828c4677, user_id=df2bf0469890450797bc54849b365100, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.588490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.592010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:44.603881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1069/2146] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:44 2022] PUT /identity/v3/projects/e0ae1cbe860f4d9d866ef1b1828c4677/users/df2bf0469890450797bc54849b365100/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:44.616518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d886c-05a2-4786-b590-93049f1c063e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.616801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d886c-05a2-4786-b590-93049f1c063e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.617073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d886c-05a2-4786-b590-93049f1c063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.645401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-166d886c-05a2-4786-b590-93049f1c063e None None] MFA Rules not processed for user `df2bf0469890450797bc54849b365100`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:44.646649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-166d886c-05a2-4786-b590-93049f1c063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:44.719150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1078/2147] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:44.723670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.787250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899d27d-c293-4423-b793-d9fd88b62752 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.792205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.793113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.793113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.793352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.794649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.796802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.824568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1070/2148] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:30:44 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:44.828715 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d886c-05a2-4786-b590-93049f1c063e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.839442 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d886c-05a2-4786-b590-93049f1c063e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.891897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:44.899198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.899845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.900234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.900514 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.901173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.903645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.925815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1079/2149] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:30:44 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:30:44.930111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.940754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1d9b-d024-49d5-8d4a-a3118563547c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.945439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.946060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.946329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.946603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.947277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.948903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:44.959485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1071/2150] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:44.963664 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:44.974200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f97f3-4ac7-4c5a-87d8-2d7502d90a8a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:44.978897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:44.979583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:44.979866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:44.980143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] PATH_INFO: `/v3/projects/f4ee2c300fdc4deb9878ee5e7221b16c/users/97f630693db8446f99aeef2d3588aacc/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:44.996484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ee2c300fdc4deb9878ee5e7221b16c, user_id=97f630693db8446f99aeef2d3588aacc, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:44.999212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:45.012231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1080/2151] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:44 2022] PUT /identity/v3/projects/f4ee2c300fdc4deb9878ee5e7221b16c/users/97f630693db8446f99aeef2d3588aacc/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:30:45.016689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:45.027846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5adff-0fb3-4be5-bef5-8c89f0db9a14 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:45.086726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9f52e-65b3-4460-81f1-adc4762bde41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:45.087444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9f52e-65b3-4460-81f1-adc4762bde41 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:45.087778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9f52e-65b3-4460-81f1-adc4762bde41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:45.088077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9f52e-65b3-4460-81f1-adc4762bde41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:45.088750 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9f52e-65b3-4460-81f1-adc4762bde41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:45.090452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9f52e-65b3-4460-81f1-adc4762bde41 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:45.101132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1072/2152] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:30:45.105274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:45.115874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad70c9-321c-427b-a2e3-3815c7c0c88c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:45.120800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:45.121565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:45.121910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:45.122323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] PATH_INFO: `/v3/projects/f4ee2c300fdc4deb9878ee5e7221b16c/users/97f630693db8446f99aeef2d3588aacc/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:45.124547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ee2c300fdc4deb9878ee5e7221b16c, user_id=97f630693db8446f99aeef2d3588aacc, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:45.127289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:45.138804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1081/2153] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:30:45 2022] PUT /identity/v3/projects/f4ee2c300fdc4deb9878ee5e7221b16c/users/97f630693db8446f99aeef2d3588aacc/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:30:45.149082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:45.149370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:45.149644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:45.185971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] MFA Rules not processed for user `97f630693db8446f99aeef2d3588aacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:30:45.187804 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:45.242986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:45.264232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1073/2154] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:30:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:30:45.276017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:45.277972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:45.341571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3c097-51e7-4130-885d-5ab8a23d5afe admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:45.345416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:45.346077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:45.346313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:45.346591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:45.356300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:45.357744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:45.368273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1082/2155] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:45.448254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:45.452653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:45.465736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afcb55-4995-4e07-8381-14e59f17b63c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:45.470061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:45.470745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:45.471019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:45.471314 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:45.533885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:45.535388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:45.544492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1074/2156] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:30:55.363188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=44,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:55.540310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=32 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:58.405579 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:30:58.407118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:58.464575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408ce30-4f4c-45e4-8104-84045c4a27f5 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:30:58.468149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa166-5db0-402b-b231-853873418d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:30:58.468753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa166-5db0-402b-b231-853873418d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:30:58.469032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa166-5db0-402b-b231-853873418d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:30:58.469303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa166-5db0-402b-b231-853873418d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:30:58.471015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-061fa166-5db0-402b-b231-853873418d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:30:58.532685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa166-5db0-402b-b231-853873418d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:30:58.534111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa166-5db0-402b-b231-853873418d6a service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:30:58.543614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1083/2157] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:00.917736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:00.937323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922f62-60bb-4a63-80a2-75e2e20575b2 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:00.943688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:00.944417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:00.944763 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:00.945101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] PATH_INFO: `/v3/users/df2bf0469890450797bc54849b365100` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:00.946300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2bf0469890450797bc54849b365100)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:00.948522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:01.002846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2bf0469890450797bc54849b365100'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.003534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2bf0469890450797bc54849b365100'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.010962 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2bf0469890450797bc54849b365100'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.019260 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2bf0469890450797bc54849b365100'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.032041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2bf0469890450797bc54849b365100'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.038084 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1075/2158] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:00 2022] DELETE /identity/v3/users/df2bf0469890450797bc54849b365100 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:01.042730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:01.044231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:01.044656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:01.064693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:01.066147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:01.175336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1084/2159] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:01.181245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:01.191952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:01.275372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ff6b-5777-44a3-b733-4683599b9fc4 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:01.279588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:01.280217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:01.280498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:01.280774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:01.292293 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:01.294334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:01.305221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1076/2160] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:01.605326 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:01.606880 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:01.621912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2f8f1-b723-40d6-845a-2d65701d722f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:01.636078 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:01.636753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:01.637031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:01.637942 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] PATH_INFO: `/v3/projects/e0ae1cbe860f4d9d866ef1b1828c4677` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:01.638967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ae1cbe860f4d9d866ef1b1828c4677)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:01.641006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:01.692235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:01.697999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ae1cbe860f4d9d866ef1b1828c4677', 'request_id': 'req-3d97e624-c8f6-4c69-a6f1-be944bade198'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.706499 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ae1cbe860f4d9d866ef1b1828c4677', 'request_id': 'req-3d97e624-c8f6-4c69-a6f1-be944bade198'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.717431 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ae1cbe860f4d9d866ef1b1828c4677', 'request_id': 'req-3d97e624-c8f6-4c69-a6f1-be944bade198'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.724679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:01.726571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:01.740732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] The token cache is being invalidate because project e0ae1cbe860f4d9d866ef1b1828c4677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:01.741039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.741743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.747383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1085/2161] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:01 2022] DELETE /identity/v3/projects/e0ae1cbe860f4d9d866ef1b1828c4677 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:01.748530 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:01.749928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:01.853919 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d8a4-d307-4186-ba66-84ff386eb528 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:01.862726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97e624-c8f6-4c69-a6f1-be944bade198 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:01.870187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:01.870914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:01.871630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:01.872608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] PATH_INFO: `/v3/users/97f630693db8446f99aeef2d3588aacc` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:01.873896 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f630693db8446f99aeef2d3588aacc)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:01.875965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:01.877163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:01.960986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f630693db8446f99aeef2d3588aacc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.961709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f630693db8446f99aeef2d3588aacc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.964324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:01.964950 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:01.965251 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:01.966242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:01.969014 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:01.973336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f630693db8446f99aeef2d3588aacc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.981918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:01.983845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:01.988093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f630693db8446f99aeef2d3588aacc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.988935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f630693db8446f99aeef2d3588aacc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:01.994279 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1077/2162] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:01.995258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:01.997361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:02.004761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1086/2163] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:01 2022] DELETE /identity/v3/users/97f630693db8446f99aeef2d3588aacc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:02.015121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c24a-cfde-495f-a8f7-70aca1c7d77b service placement] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.080961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.081592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.081874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.082150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] PATH_INFO: `/v3/users/815494a41aaa400c99841f38ffd50c63` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.083508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=815494a41aaa400c99841f38ffd50c63)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.085470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.145225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815494a41aaa400c99841f38ffd50c63'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.145970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815494a41aaa400c99841f38ffd50c63'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.153578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815494a41aaa400c99841f38ffd50c63'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.160617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815494a41aaa400c99841f38ffd50c63'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.179679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815494a41aaa400c99841f38ffd50c63'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.188816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1078/2164] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:01 2022] DELETE /identity/v3/users/815494a41aaa400c99841f38ffd50c63 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:02.314646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.316157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:02.339143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4976cf9-8532-489b-a8dc-ac3d10fa8c01 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.378643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.380227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:02.402068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:02.415431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:02.415673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.416321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.417100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.417403 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] PATH_INFO: `/v3/projects/f4ee2c300fdc4deb9878ee5e7221b16c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.418746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ee2c300fdc4deb9878ee5e7221b16c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.420747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.452909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb5643-07e8-4ab5-adb3-92b2bea50707 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.457890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.458531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.458814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.459108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] PATH_INFO: `/v3/projects/a2a3d48917b04965801f83f3ee9f9259` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.460661 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a3d48917b04965801f83f3ee9f9259)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.462729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.470392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ee2c300fdc4deb9878ee5e7221b16c', 'request_id': 'req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.477145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ee2c300fdc4deb9878ee5e7221b16c', 'request_id': 'req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.483233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ee2c300fdc4deb9878ee5e7221b16c', 'request_id': 'req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.498806 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] The token cache is being invalidate because project f4ee2c300fdc4deb9878ee5e7221b16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:02.499214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.499821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6b5ef6e6-6e33-4083-b4e1-bf0e11dd5a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.501609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1087/2165] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:02 2022] DELETE /identity/v3/projects/f4ee2c300fdc4deb9878ee5e7221b16c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:02.508445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949be4-97eb-4475-ac77-1e174684a1d8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.508809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949be4-97eb-4475-ac77-1e174684a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.508996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949be4-97eb-4475-ac77-1e174684a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.522767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a3d48917b04965801f83f3ee9f9259', 'request_id': 'req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.530810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a3d48917b04965801f83f3ee9f9259', 'request_id': 'req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.531361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fd949be4-97eb-4475-ac77-1e174684a1d8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:02.532773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fd949be4-97eb-4475-ac77-1e174684a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:02.540125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a3d48917b04965801f83f3ee9f9259', 'request_id': 'req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.554228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] The token cache is being invalidate because project a2a3d48917b04965801f83f3ee9f9259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:02.554444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.555146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-9f6b4a2f-3f5d-4637-b865-1ca07d0fdf97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:02.557479 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1079/2166] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:02 2022] DELETE /identity/v3/projects/a2a3d48917b04965801f83f3ee9f9259 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:02.562289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157709d-1f58-4b96-9051-ccf481f4f75e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.562593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157709d-1f58-4b96-9051-ccf481f4f75e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.562834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157709d-1f58-4b96-9051-ccf481f4f75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.584274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b157709d-1f58-4b96-9051-ccf481f4f75e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:02.585525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b157709d-1f58-4b96-9051-ccf481f4f75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:02.606064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1088/2167] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:02.613639 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2158a-f258-441e-97a6-0640cfa0f410 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.613931 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2158a-f258-441e-97a6-0640cfa0f410 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.614209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2158a-f258-441e-97a6-0640cfa0f410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.636744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0dc2158a-f258-441e-97a6-0640cfa0f410 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:02.638596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0dc2158a-f258-441e-97a6-0640cfa0f410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:02.647237 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1089/2168] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:02.651292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2158a-f258-441e-97a6-0640cfa0f410 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.661147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2158a-f258-441e-97a6-0640cfa0f410 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.662398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1080/2169] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:02.666258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.666866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.667178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.667458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.668112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:02.668513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.669998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c5e6-b00f-4eb0-80ab-ef8db35bb5c4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.670272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.670410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c5e6-b00f-4eb0-80ab-ef8db35bb5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.670570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c5e6-b00f-4eb0-80ab-ef8db35bb5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.686405 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1090/2170] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:31:02.687335 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.692081 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-fa42c5e6-b00f-4eb0-80ab-ef8db35bb5c4 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:02.693295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fa42c5e6-b00f-4eb0-80ab-ef8db35bb5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:02.696905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ed7d8-a9bd-4dba-ac83-434342747251 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.701931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1081/2171] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:02.702140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.702696 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.702974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.703265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.703887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.705773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.706608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c5e6-b00f-4eb0-80ab-ef8db35bb5c4 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.715797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c5e6-b00f-4eb0-80ab-ef8db35bb5c4 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.720583 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.721188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.721470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.721746 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.722532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:02.722852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.724510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.734767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1091/2172] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:02.738811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.739811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1082/2173] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:31:02.744528 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.754534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2856-0019-40e5-a0b7-377098e7cb04 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.784895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:02.788996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:02.805174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052f8d3-73b3-443c-a454-a0f7a9d746ce admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.811235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.811847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.812127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.812396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.813033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.814948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.815959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.816568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.816846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.817143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.817773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.819708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.836839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1092/2174] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:02.841496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.850047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1083/2175] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:02.851364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827a4d1-fbbb-41f0-b355-dbeb0b18fb59 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.852139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.917267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.918050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.918331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.919533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.921313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.923003 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.926132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652d205-3d0a-487d-b01a-545fd4356dee admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.932149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.932840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.933182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.933519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.937371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1093/2176] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:02.937521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.937521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.938338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.948331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542407a-39e9-4d66-b72e-a1a737923705 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.954243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.954813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.955115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.955396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.956045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.957657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:02.960906 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1084/2177] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:02 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:02.966020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.977833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e294c41-769e-437d-9049-d14a516d2eef admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:02.984590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1094/2178] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:02.987833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:02.987966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:02.988720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:02.989186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:02.989473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:02.990129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:02.991791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.007017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1085/2179] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:03.007231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cd19d-423b-42b3-bdbe-3ad18e36b1c9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.007366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.007366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.009671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.010328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.010700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.010878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] PATH_INFO: `/v3/projects/c08a0a933700445d9e7f7627a71dadab/users/e20510e0331349d7bd25b519aba3cd1e/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.019685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5d62-0b25-4982-8f33-206d2e721441 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.024986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.025590 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.025865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.026135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] PATH_INFO: `/v3/users/a96053a1cdd94b498cc214b7939f5356` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.026357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08a0a933700445d9e7f7627a71dadab, user_id=e20510e0331349d7bd25b519aba3cd1e, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.027284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96053a1cdd94b498cc214b7939f5356)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.029691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.029837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.043661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1095/2180] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:02 2022] PUT /identity/v3/projects/c08a0a933700445d9e7f7627a71dadab/users/e20510e0331349d7bd25b519aba3cd1e/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:03.044543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.079901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96053a1cdd94b498cc214b7939f5356'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:03.080587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96053a1cdd94b498cc214b7939f5356'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:03.087740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96053a1cdd94b498cc214b7939f5356'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:03.095715 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96053a1cdd94b498cc214b7939f5356'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:03.108091 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2667e253-b36d-4260-bcf4-567c3ead297a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96053a1cdd94b498cc214b7939f5356'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:03.114150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1086/2181] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:03 2022] DELETE /identity/v3/users/a96053a1cdd94b498cc214b7939f5356 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:03.115135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.115416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.115686 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.121291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8956d5-ee82-4286-8617-9c4961190aa4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.142501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:03.145472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] MFA Rules not processed for user `e20510e0331349d7bd25b519aba3cd1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:03.146805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.161694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:03.184833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d00ea-c42c-4a0a-8af4-7d9be008a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.185564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d00ea-c42c-4a0a-8af4-7d9be008a6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.185916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d00ea-c42c-4a0a-8af4-7d9be008a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.186261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d00ea-c42c-4a0a-8af4-7d9be008a6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.187054 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d00ea-c42c-4a0a-8af4-7d9be008a6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.188791 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d00ea-c42c-4a0a-8af4-7d9be008a6bc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.199597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1096/2182] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:03.201510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.201799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.202094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.220989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1087/2183] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:03.221812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.222481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:03.223126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.224427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.232617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1097/2184] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:03.233746 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.236634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.237841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68117431-2ac5-4739-85e1-61ec614c7e42 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.242376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.243028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.243358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.243635 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] PATH_INFO: `/v3/projects/bc66af8d9c8a407e8d3883e4e230a49e/users/f945d5806ea342278d9bbca9f9d4e6b0/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.249500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab1628-6463-4cd1-b443-84aead4459d5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.254112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cf20c-63ca-4522-8e00-0c2b0da2580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.254737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cf20c-63ca-4522-8e00-0c2b0da2580e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.255117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cf20c-63ca-4522-8e00-0c2b0da2580e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.255400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cf20c-63ca-4522-8e00-0c2b0da2580e admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.256041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cf20c-63ca-4522-8e00-0c2b0da2580e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.257943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cf20c-63ca-4522-8e00-0c2b0da2580e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.259486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc66af8d9c8a407e8d3883e4e230a49e, user_id=f945d5806ea342278d9bbca9f9d4e6b0, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.262123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.274822 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1088/2185] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:03 2022] PUT /identity/v3/projects/bc66af8d9c8a407e8d3883e4e230a49e/users/f945d5806ea342278d9bbca9f9d4e6b0/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:03.275499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.277319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.287895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1098/2186] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:03.289258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096411ee-4356-49b4-81cd-e83a22ceab04 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.289550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096411ee-4356-49b4-81cd-e83a22ceab04 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.289747 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096411ee-4356-49b4-81cd-e83a22ceab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.318279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-096411ee-4356-49b4-81cd-e83a22ceab04 None None] MFA Rules not processed for user `f945d5806ea342278d9bbca9f9d4e6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:03.319538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-096411ee-4356-49b4-81cd-e83a22ceab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.335631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e9f3-658a-4857-ad7b-e89d44152511 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.385351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1099/2187] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:03.387037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096411ee-4356-49b4-81cd-e83a22ceab04 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.387483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.388236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.388522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.388792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.438011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:03.451497 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096411ee-4356-49b4-81cd-e83a22ceab04 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.453210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.454668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.456108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.456712 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.456992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.457264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.457893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.459830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.464287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1089/2188] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:03.465115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.477045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc3d2-0a0e-4e34-a723-a0deb0dbba97 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.482605 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5994-2880-431c-8662-2053430b798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.483252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5994-2880-431c-8662-2053430b798c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.483535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5994-2880-431c-8662-2053430b798c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.484156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5994-2880-431c-8662-2053430b798c admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.484721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5994-2880-431c-8662-2053430b798c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.484856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1100/2189] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:03.488423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.489447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5994-2880-431c-8662-2053430b798c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.498769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7713a52-b81f-4d96-8c86-65373dc92ada admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.504624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.505543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.505946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.506363 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.507194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.509193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.519932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1090/2190] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:03.523303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1101/2191] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:03.527241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5994-2880-431c-8662-2053430b798c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.527467 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.539932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb5b9c-2c09-48ef-965f-e307081f9229 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.555305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:03.601453 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5994-2880-431c-8662-2053430b798c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.606737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.607890 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.608497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.608497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.609214 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.611265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.612882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.613670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.614038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.614493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] PATH_INFO: `/v3/projects/8d44993434824979b6fd0b1e129abab2/users/7de5095758d94ae59f5b730ed3ae0a88/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.638535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d44993434824979b6fd0b1e129abab2, user_id=7de5095758d94ae59f5b730ed3ae0a88, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.642099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.652240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1091/2192] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/users => generated 308 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:03.656169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.661739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1102/2193] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:03 2022] PUT /identity/v3/projects/8d44993434824979b6fd0b1e129abab2/users/7de5095758d94ae59f5b730ed3ae0a88/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:03.663049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.666695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758b4e-1c27-4cd6-b429-21138bb022f6 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.734150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.734797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.735089 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.735370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.736019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.737776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.743854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1b1e0-aa3a-4b7f-b07b-4d6dcbb51520 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.750019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1092/2194] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:03.750316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.750932 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.751267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.751609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.752294 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.754229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.754352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.764959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef04ea-1b20-49ab-a744-3eac26ce8ffa admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.766392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1103/2195] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:03.770719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.775723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abdfc8-b03d-4f55-823c-701485032d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.776393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abdfc8-b03d-4f55-823c-701485032d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.776674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abdfc8-b03d-4f55-823c-701485032d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.776952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abdfc8-b03d-4f55-823c-701485032d63 admin admin] PATH_INFO: `/v3/projects/37dd1e7ce15049438dd5cdde683a531c/users/0668ff525c524c308786aa83ba283f1d/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.784125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3c1c9-e255-4298-8843-d9e2aad6d08c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.789702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.790373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.790659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.790995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] PATH_INFO: `/v3/projects/8d44993434824979b6fd0b1e129abab2/users/7de5095758d94ae59f5b730ed3ae0a88/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.792949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abdfc8-b03d-4f55-823c-701485032d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dd1e7ce15049438dd5cdde683a531c, user_id=0668ff525c524c308786aa83ba283f1d, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.793086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d44993434824979b6fd0b1e129abab2, user_id=7de5095758d94ae59f5b730ed3ae0a88, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.796197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abdfc8-b03d-4f55-823c-701485032d63 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.796487 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.809985 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1104/2196] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:03 2022] PUT /identity/v3/projects/8d44993434824979b6fd0b1e129abab2/users/7de5095758d94ae59f5b730ed3ae0a88/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:03.810828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.818691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.822416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1093/2197] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:03 2022] PUT /identity/v3/projects/37dd1e7ce15049438dd5cdde683a531c/users/0668ff525c524c308786aa83ba283f1d/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:03.826628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1ae6-e460-4bbc-810b-89ef9835cde8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.826921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1ae6-e460-4bbc-810b-89ef9835cde8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.827239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1ae6-e460-4bbc-810b-89ef9835cde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.854888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3fcb1ae6-e460-4bbc-810b-89ef9835cde8 None None] MFA Rules not processed for user `7de5095758d94ae59f5b730ed3ae0a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:03.856074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3fcb1ae6-e460-4bbc-810b-89ef9835cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:03.868541 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:03.888902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aa1c3-e0a8-4936-99ed-2b79909a1028 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:03.914558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:03.930083 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1094/2198] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:03.931016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1ae6-e460-4bbc-810b-89ef9835cde8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:03.952426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:03.953066 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:03.953351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:03.953636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] PATH_INFO: `/v3/projects/92af470f770c4dfbb8a7dfec4e111561` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:03.954790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92af470f770c4dfbb8a7dfec4e111561)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:03.956767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:03.998523 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1ae6-e460-4bbc-810b-89ef9835cde8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.006247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92af470f770c4dfbb8a7dfec4e111561', 'request_id': 'req-0a17f0d3-72b2-43b4-8a77-a94baeae6461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.013124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92af470f770c4dfbb8a7dfec4e111561', 'request_id': 'req-0a17f0d3-72b2-43b4-8a77-a94baeae6461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.020076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92af470f770c4dfbb8a7dfec4e111561', 'request_id': 'req-0a17f0d3-72b2-43b4-8a77-a94baeae6461'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.034150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] The token cache is being invalidate because project 92af470f770c4dfbb8a7dfec4e111561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:04.034443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.035258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.036810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1105/2199] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:03 2022] DELETE /identity/v3/projects/92af470f770c4dfbb8a7dfec4e111561 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:04.037670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.039259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.056771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65c6c5-517f-449b-9b6c-ba698aa2ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.057403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65c6c5-517f-449b-9b6c-ba698aa2ae0c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.057687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65c6c5-517f-449b-9b6c-ba698aa2ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.058488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65c6c5-517f-449b-9b6c-ba698aa2ae0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.059182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65c6c5-517f-449b-9b6c-ba698aa2ae0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.061796 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65c6c5-517f-449b-9b6c-ba698aa2ae0c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.076197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1095/2200] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:04.076197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.076197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.076197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.094548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:04.095786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.098547 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17f0d3-72b2-43b4-8a77-a94baeae6461 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.102196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7b214-7fdd-4975-b412-d39916dc14a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.102805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7b214-7fdd-4975-b412-d39916dc14a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.103102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7b214-7fdd-4975-b412-d39916dc14a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.103400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7b214-7fdd-4975-b412-d39916dc14a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.103751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1096/2201] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:04.104499 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.105598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-81c7b214-7fdd-4975-b412-d39916dc14a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.105733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.117983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c728-01fb-48ae-b008-7c9b51f73472 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.123348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327f92-7038-48f0-ae51-77c34d178924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.123989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327f92-7038-48f0-ae51-77c34d178924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.124266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327f92-7038-48f0-ae51-77c34d178924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.124545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327f92-7038-48f0-ae51-77c34d178924 admin admin] PATH_INFO: `/v3/projects/37dd1e7ce15049438dd5cdde683a531c/users/0668ff525c524c308786aa83ba283f1d/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.126423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327f92-7038-48f0-ae51-77c34d178924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dd1e7ce15049438dd5cdde683a531c, user_id=0668ff525c524c308786aa83ba283f1d, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.129111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327f92-7038-48f0-ae51-77c34d178924 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.140195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1097/2202] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:04 2022] PUT /identity/v3/projects/37dd1e7ce15049438dd5cdde683a531c/users/0668ff525c524c308786aa83ba283f1d/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:04.144494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.144880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.145250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.165712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:04.166924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.177898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7b214-7fdd-4975-b412-d39916dc14a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.179550 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7b214-7fdd-4975-b412-d39916dc14a3 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.189996 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1106/2203] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:04.191315 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032abe8-29d3-4763-8e0d-5876c46ba8be None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.191600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032abe8-29d3-4763-8e0d-5876c46ba8be None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.191891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032abe8-29d3-4763-8e0d-5876c46ba8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.202522 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:04.215427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:04.233153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-6032abe8-29d3-4763-8e0d-5876c46ba8be None None] MFA Rules not processed for user `0668ff525c524c308786aa83ba283f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:04.235768 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6032abe8-29d3-4763-8e0d-5876c46ba8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.239332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1098/2204] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:04.240031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.243593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.327759 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05311a0-4f35-4f55-9941-a0fa81d6fba2 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.332374 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.333469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.333761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.334039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.336659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.339342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1107/2205] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:04.340596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032abe8-29d3-4763-8e0d-5876c46ba8be None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.353444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032abe8-29d3-4763-8e0d-5876c46ba8be None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.359539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.360731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.360731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.360731 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.361615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:04.361957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.364112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.380864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1108/2206] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:04.380864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.400341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5912881-ba6a-43f1-b80f-ac1357d2f5ff admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.404495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.405113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.405400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.405674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.415244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.416721 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.422058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.423897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.426775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1109/2207] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:04.427573 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.433054 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1099/2208] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:04.438310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57567132-3d95-45f4-8c86-7f1dca8d9a1e service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.442988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.443625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.443914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.444192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.444832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.446777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.482829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1110/2209] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:04 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:04.487432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.498428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714b75-d190-459e-9f33-b43810a42f0c service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.593065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.593685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.593963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.594241 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.595057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.597300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.632455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1100/2210] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:04 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:04.636785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.652580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d091-49db-4cd0-9808-ed84ae1d7872 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.663862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.663862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.663862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.663862 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.664374 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.665770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.667143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.681262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7da7b6-167c-4e64-ba01-1b28ad959a4a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.688362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1111/2211] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:04.692749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.692903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.693624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.694099 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.694469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] PATH_INFO: `/v3/users/f945d5806ea342278d9bbca9f9d4e6b0` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.695769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f945d5806ea342278d9bbca9f9d4e6b0)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.698721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.707485 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae631af3-36fd-4ff3-bccb-8260d3bfe5dc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.717235 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.717982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:04.718459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.718781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.719534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.720331 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.722071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.733680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1112/2212] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:04.740521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.763258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d1451-c76b-4f5b-916f-80bd542fe7ad admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:04.772805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15a3ed-ce74-4d51-a1aa-4a2218588ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:04.774040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a3ed-ce74-4d51-a1aa-4a2218588ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.774345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a3ed-ce74-4d51-a1aa-4a2218588ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.774611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a3ed-ce74-4d51-a1aa-4a2218588ceb admin admin] PATH_INFO: `/v3/projects/5d367460c5b0449cb31e5ebb836daf08/users/19fcdf834f2140caab1986e857b973de/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.775559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f945d5806ea342278d9bbca9f9d4e6b0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.776395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f945d5806ea342278d9bbca9f9d4e6b0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.786692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f945d5806ea342278d9bbca9f9d4e6b0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.797486 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f945d5806ea342278d9bbca9f9d4e6b0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.810846 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15a3ed-ce74-4d51-a1aa-4a2218588ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d367460c5b0449cb31e5ebb836daf08, user_id=19fcdf834f2140caab1986e857b973de, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:04.819059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-347341ed-ab97-4708-b816-4c8d9229d7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f945d5806ea342278d9bbca9f9d4e6b0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:04.821070 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15a3ed-ce74-4d51-a1aa-4a2218588ceb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:04.826008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1101/2213] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:04 2022] DELETE /identity/v3/users/f945d5806ea342278d9bbca9f9d4e6b0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:04.831498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.832214 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.832986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.837677 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1113/2214] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:04 2022] PUT /identity/v3/projects/5d367460c5b0449cb31e5ebb836daf08/users/19fcdf834f2140caab1986e857b973de/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:04.850365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:04.850649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:04.850933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:04.864748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:04.866741 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.909828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] MFA Rules not processed for user `19fcdf834f2140caab1986e857b973de`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:04.909828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.947526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1102/2215] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:04.957562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.959002 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:04.962484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:04.986128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1114/2216] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:04.998498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:04.999893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:05.022618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458ac9-272e-4d08-8b1f-127e03f2cd86 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:05.026303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:05.026918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:05.027235 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:05.027511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:05.037196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:05.038630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:05.049097 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1103/2217] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:05.059111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a354c-226e-4b2d-9694-68b818856204 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:05.062799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:05.063454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:05.063740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:05.064018 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:05.072580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:05.074012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:05.083099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1115/2218] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:05.329336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:05.331788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:05.350182 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195bb5-43b0-4eae-afc1-5f6610931252 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:05.357146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:05.358046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:05.358521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:05.359217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] PATH_INFO: `/v3/projects/bc66af8d9c8a407e8d3883e4e230a49e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:05.360291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc66af8d9c8a407e8d3883e4e230a49e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:05.364133 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:05.400192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:05.419970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc66af8d9c8a407e8d3883e4e230a49e', 'request_id': 'req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.426792 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc66af8d9c8a407e8d3883e4e230a49e', 'request_id': 'req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.433766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc66af8d9c8a407e8d3883e4e230a49e', 'request_id': 'req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.445468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] The token cache is being invalidate because project bc66af8d9c8a407e8d3883e4e230a49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:05.446019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.446700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.448342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1104/2219] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:05 2022] DELETE /identity/v3/projects/bc66af8d9c8a407e8d3883e4e230a49e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:05.453163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:05.464800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec357d-0a8c-46e4-9f67-f374a4cbc6c4 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:05.522787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:05.523458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:05.523739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:05.524019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] PATH_INFO: `/v3/users/0668ff525c524c308786aa83ba283f1d` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:05.525159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0668ff525c524c308786aa83ba283f1d)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:05.527169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:05.589824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0668ff525c524c308786aa83ba283f1d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.591035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0668ff525c524c308786aa83ba283f1d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.598404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0668ff525c524c308786aa83ba283f1d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.610793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0668ff525c524c308786aa83ba283f1d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.611551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f981f904-a9f2-4389-942d-b87fb42ac809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0668ff525c524c308786aa83ba283f1d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:05.625577 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1116/2220] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:05 2022] DELETE /identity/v3/users/0668ff525c524c308786aa83ba283f1d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:05.897405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:05.898845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:05.916368 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966bd41-df9d-4cdb-b7ca-7f08b386bedc admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:05.986883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:05.987690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:05.989709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:05.989709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] PATH_INFO: `/v3/projects/37dd1e7ce15049438dd5cdde683a531c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:05.989934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dd1e7ce15049438dd5cdde683a531c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:05.992456 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.053216 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dd1e7ce15049438dd5cdde683a531c', 'request_id': 'req-429fcba9-4c2c-4129-8661-aed403913fff'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:06.061420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dd1e7ce15049438dd5cdde683a531c', 'request_id': 'req-429fcba9-4c2c-4129-8661-aed403913fff'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:06.071388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dd1e7ce15049438dd5cdde683a531c', 'request_id': 'req-429fcba9-4c2c-4129-8661-aed403913fff'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:06.087250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] The token cache is being invalidate because project 37dd1e7ce15049438dd5cdde683a531c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:06.087550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:06.088231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-429fcba9-4c2c-4129-8661-aed403913fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:06.091153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1105/2221] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:05 2022] DELETE /identity/v3/projects/37dd1e7ce15049438dd5cdde683a531c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:06.095415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b1c5-8f73-4852-ad5f-7de69d6da174 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.095712 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b1c5-8f73-4852-ad5f-7de69d6da174 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.095999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b1c5-8f73-4852-ad5f-7de69d6da174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.124309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b5e2b1c5-8f73-4852-ad5f-7de69d6da174 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:06.125505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b5e2b1c5-8f73-4852-ad5f-7de69d6da174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:06.130905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:06.193527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1117/2222] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:06.201647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d920-614c-448a-9893-533a3d382b33 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.201930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d920-614c-448a-9893-533a3d382b33 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.202194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d920-614c-448a-9893-533a3d382b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.223556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-edd1d920-614c-448a-9893-533a3d382b33 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:06.224794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-edd1d920-614c-448a-9893-533a3d382b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:06.233426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1106/2223] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:06.238022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b1c5-8f73-4852-ad5f-7de69d6da174 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:06.249367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b1c5-8f73-4852-ad5f-7de69d6da174 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:06.254147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:06.254785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.255073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.255374 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.256022 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:06.256416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:06.257918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.271121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1118/2224] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:06.274959 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d920-614c-448a-9893-533a3d382b33 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:06.285415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d920-614c-448a-9893-533a3d382b33 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:06.290139 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:06.290738 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.291015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.291315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.291961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:06.293894 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.325419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1107/2225] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:06 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:06.328538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:06.341259 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead399bb-462d-44d9-bf2a-d09eff975e78 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:06.415772 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:06.416466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.417033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.417476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.418192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:06.420412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.448146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1119/2226] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:06 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:06.453321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:06.464565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af3426-0af8-48a0-b77f-fa420cd91556 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:06.469609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:06.470209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.470489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.470761 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.471441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:06.473103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.488550 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1108/2227] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:06.492502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:06.503517 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966c65-6a70-49f2-8195-eea3c64599f5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:06.508390 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54360303-844b-4de6-b1a0-450cfa4c8411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:06.508981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360303-844b-4de6-b1a0-450cfa4c8411 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.509264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360303-844b-4de6-b1a0-450cfa4c8411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.509540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360303-844b-4de6-b1a0-450cfa4c8411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.510192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54360303-844b-4de6-b1a0-450cfa4c8411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:06.511868 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54360303-844b-4de6-b1a0-450cfa4c8411 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.523569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1120/2228] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:06.527795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:06.537963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db4bd5-682c-4660-8b62-c134a8ba6265 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:06.542813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:06.543531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.543816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.544094 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] PATH_INFO: `/v3/projects/302502d41761429bbb1a0ed60ef6a1d9/users/862917c799b5468d89ff503416c4c37b/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.546544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:06.563038 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302502d41761429bbb1a0ed60ef6a1d9, user_id=862917c799b5468d89ff503416c4c37b, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:06.565786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.583696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1109/2229] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:06 2022] PUT /identity/v3/projects/302502d41761429bbb1a0ed60ef6a1d9/users/862917c799b5468d89ff503416c4c37b/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:06.589081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c63dd-c2c7-44f7-b71d-3b98fe5277fc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.589436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c63dd-c2c7-44f7-b71d-3b98fe5277fc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.589719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c63dd-c2c7-44f7-b71d-3b98fe5277fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.610576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8f9c63dd-c2c7-44f7-b71d-3b98fe5277fc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:06.611993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8f9c63dd-c2c7-44f7-b71d-3b98fe5277fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:06.690620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1121/2230] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:06.701302 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:06.703848 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:06.770249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c739aa0-7726-43fb-90a3-87f158eeaa37 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:06.774989 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:06.775559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:06.775839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:06.776121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:06.790895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:06.792533 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:06.804282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1110/2231] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:07.677438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539edff2-5b3d-4787-81b7-25877d371fb6 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:07.678480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539edff2-5b3d-4787-81b7-25877d371fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:07.678981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539edff2-5b3d-4787-81b7-25877d371fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:07.726515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-539edff2-5b3d-4787-81b7-25877d371fb6 None None] MFA Rules not processed for user `862917c799b5468d89ff503416c4c37b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:07.727956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-539edff2-5b3d-4787-81b7-25877d371fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:07.735220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:07.810787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1122/2232] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:07.815670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:07.827393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5fc0e-0fad-4425-b293-d26f5c37d5ca service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:07.832673 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:07.833530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:07.834437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:07.834720 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:07.835474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:07.837432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:07.888469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1111/2233] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:07 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:07.892670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539edff2-5b3d-4787-81b7-25877d371fb6 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:07.909252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539edff2-5b3d-4787-81b7-25877d371fb6 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:07.998111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:07.998716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:07.999058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:07.999367 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.000079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:08.002251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:08.035159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1123/2234] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:07 2022] POST /identity/v3/users => generated 308 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:08.039582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:08.068073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef50c-5613-444d-8058-9601bab7038d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:08.077844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:08.077844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:08.077844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:08.077844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.078371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:08.079502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:08.093330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1112/2235] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:08.097516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:08.111785 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384b755-52fd-46e9-ba99-48d3a703e7fc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:08.116832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:08.117603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:08.117956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:08.118303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] PATH_INFO: `/v3/projects/130dc51763fe4f9e95837e3272d06cfd/users/a259218548b74b50af6c14b029b8d33d/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.135804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130dc51763fe4f9e95837e3272d06cfd, user_id=a259218548b74b50af6c14b029b8d33d, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:08.139200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:08.156422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1124/2236] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:08 2022] PUT /identity/v3/projects/130dc51763fe4f9e95837e3272d06cfd/users/a259218548b74b50af6c14b029b8d33d/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:08.161244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:08.177554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07efde-9888-45b1-b22d-e510a39dbb32 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:08.217803 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:08.220545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:08.259921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:08.260812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:08.261259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:08.261560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.262571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:08.264482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:08.276492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1113/2237] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:08.280769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:08.291458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479965b-e3d9-41fe-8a57-e3966f57af93 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:08.297297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738c961-19b7-4740-86a3-a99205b7d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:08.297810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c961-19b7-4740-86a3-a99205b7d095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:08.298087 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c961-19b7-4740-86a3-a99205b7d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:08.298863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c961-19b7-4740-86a3-a99205b7d095 admin admin] PATH_INFO: `/v3/projects/130dc51763fe4f9e95837e3272d06cfd/users/a259218548b74b50af6c14b029b8d33d/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.301108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738c961-19b7-4740-86a3-a99205b7d095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130dc51763fe4f9e95837e3272d06cfd, user_id=a259218548b74b50af6c14b029b8d33d, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:08.303328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f6057-e355-4a96-95b3-e987b58ff840 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:08.303803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738c961-19b7-4740-86a3-a99205b7d095 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:08.308804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:08.310120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:08.310501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:08.310881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] PATH_INFO: `/v3/users/e20510e0331349d7bd25b519aba3cd1e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.312171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20510e0331349d7bd25b519aba3cd1e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:08.314212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:08.315342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1114/2238] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:08 2022] PUT /identity/v3/projects/130dc51763fe4f9e95837e3272d06cfd/users/a259218548b74b50af6c14b029b8d33d/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:08.330623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:08.386384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20510e0331349d7bd25b519aba3cd1e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:08.387239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20510e0331349d7bd25b519aba3cd1e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:08.399900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20510e0331349d7bd25b519aba3cd1e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:08.426556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20510e0331349d7bd25b519aba3cd1e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:08.427905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20510e0331349d7bd25b519aba3cd1e'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:08.445650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1125/2239] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:08 2022] DELETE /identity/v3/users/e20510e0331349d7bd25b519aba3cd1e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:08.447343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e94be-9a12-449e-90e7-d9a81654a7d7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:08.447633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e94be-9a12-449e-90e7-d9a81654a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:08.447908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e94be-9a12-449e-90e7-d9a81654a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.471925 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2e7e94be-9a12-449e-90e7-d9a81654a7d7 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:08.473247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2e7e94be-9a12-449e-90e7-d9a81654a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:08.514318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:08.558432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1115/2240] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:08.571598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:08.573056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:08.649498 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876ac4f-4868-4715-a9fd-1982c2ef9989 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:08.661162 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:08.663182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:08.663473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:08.663757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:08.684920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:08.687488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:08.702709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1126/2241] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:09.226039 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cc13-2afe-4d8a-b04d-44b8a466ada6 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:09.227404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cc13-2afe-4d8a-b04d-44b8a466ada6 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:09.227983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cc13-2afe-4d8a-b04d-44b8a466ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:09.247470 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:09.249009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:09.272974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d3ad0-f668-413f-8dff-b6cb6d5edb82 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:09.280704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:09.281355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:09.281640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:09.281919 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] PATH_INFO: `/v3/projects/c08a0a933700445d9e7f7627a71dadab` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:09.285002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08a0a933700445d9e7f7627a71dadab)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:09.287843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e145cc13-2afe-4d8a-b04d-44b8a466ada6 None None] MFA Rules not processed for user `a259218548b74b50af6c14b029b8d33d`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:09.289088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e145cc13-2afe-4d8a-b04d-44b8a466ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:09.290795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:09.361524 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08a0a933700445d9e7f7627a71dadab', 'request_id': 'req-de50b4fb-770c-4c55-a51a-058c2943abe5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.371925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08a0a933700445d9e7f7627a71dadab', 'request_id': 'req-de50b4fb-770c-4c55-a51a-058c2943abe5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.390694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08a0a933700445d9e7f7627a71dadab', 'request_id': 'req-de50b4fb-770c-4c55-a51a-058c2943abe5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.399391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1116/2242] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:09 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:09.411408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] The token cache is being invalidate because project c08a0a933700445d9e7f7627a71dadab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:09.411820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.412591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.414895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1127/2243] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:09 2022] DELETE /identity/v3/projects/c08a0a933700445d9e7f7627a71dadab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:09.419506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cc13-2afe-4d8a-b04d-44b8a466ada6 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:09.430972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cc13-2afe-4d8a-b04d-44b8a466ada6 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:09.497074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:09.498751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:09.498751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:09.498751 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] PATH_INFO: `/v3/users/7de5095758d94ae59f5b730ed3ae0a88` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:09.499454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de5095758d94ae59f5b730ed3ae0a88)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:09.501455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:09.565531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de5095758d94ae59f5b730ed3ae0a88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.566242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de5095758d94ae59f5b730ed3ae0a88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.573600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de5095758d94ae59f5b730ed3ae0a88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.582205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de5095758d94ae59f5b730ed3ae0a88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.583708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:09.598841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-920464e0-f3bd-4664-9afa-76f6d2e042cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de5095758d94ae59f5b730ed3ae0a88'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:09.604866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1117/2244] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:09 2022] DELETE /identity/v3/users/7de5095758d94ae59f5b730ed3ae0a88 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:09.907289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:09.909031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:09.930814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b4fb-770c-4c55-a51a-058c2943abe5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:09.947510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:10.001113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.001834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.002141 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.002401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] PATH_INFO: `/v3/projects/8d44993434824979b6fd0b1e129abab2` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.003695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d44993434824979b6fd0b1e129abab2)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.005614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.055293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d44993434824979b6fd0b1e129abab2', 'request_id': 'req-21524db0-f15b-44dc-8120-9a02942d96b2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.062173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d44993434824979b6fd0b1e129abab2', 'request_id': 'req-21524db0-f15b-44dc-8120-9a02942d96b2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.067810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d44993434824979b6fd0b1e129abab2', 'request_id': 'req-21524db0-f15b-44dc-8120-9a02942d96b2'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.080820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] The token cache is being invalidate because project 8d44993434824979b6fd0b1e129abab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:10.081115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.082030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-21524db0-f15b-44dc-8120-9a02942d96b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.083588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1128/2245] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:09 2022] DELETE /identity/v3/projects/8d44993434824979b6fd0b1e129abab2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:10.088464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90d153-deb3-4fcc-91dd-3cdc6243439c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.088818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90d153-deb3-4fcc-91dd-3cdc6243439c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.089158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90d153-deb3-4fcc-91dd-3cdc6243439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.112467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3b90d153-deb3-4fcc-91dd-3cdc6243439c None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:10.115948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3b90d153-deb3-4fcc-91dd-3cdc6243439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.185117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1118/2246] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:10.193093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b54d-6865-41f8-981b-9721d2d82637 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.193384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b54d-6865-41f8-981b-9721d2d82637 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.193660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b54d-6865-41f8-981b-9721d2d82637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.215030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1c24b54d-6865-41f8-981b-9721d2d82637 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:10.216378 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1c24b54d-6865-41f8-981b-9721d2d82637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.224701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1129/2247] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:10.229191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90d153-deb3-4fcc-91dd-3cdc6243439c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.239403 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90d153-deb3-4fcc-91dd-3cdc6243439c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.244090 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.244711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.244992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.245264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.245923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:10.247258 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.248654 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.262045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1119/2248] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:10.267271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b54d-6865-41f8-981b-9721d2d82637 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.271735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.274361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.283904 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b54d-6865-41f8-981b-9721d2d82637 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.289511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.290602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.291104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.291596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.292465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d51662-137e-4c10-aadc-f3948bd88be0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.292850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.295319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.301689 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.302402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.302723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.302992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] PATH_INFO: `/v3/users/19fcdf834f2140caab1986e857b973de` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.304830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fcdf834f2140caab1986e857b973de)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.307102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.335860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1130/2249] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:10.339835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.369789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fcdf834f2140caab1986e857b973de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.370921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fcdf834f2140caab1986e857b973de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.381572 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fcdf834f2140caab1986e857b973de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.391451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fcdf834f2140caab1986e857b973de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.409071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c4c3683a-a1c2-4947-964a-8bd1b6339b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fcdf834f2140caab1986e857b973de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.416445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1120/2250] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:10 2022] DELETE /identity/v3/users/19fcdf834f2140caab1986e857b973de => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:10.421674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.422032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.422326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.427947 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e71c-d225-477d-babb-cb32f7af89aa admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.442338 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:10.443670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.457151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:10.480425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:10.500092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.500815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.501468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.501753 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.502671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.504680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.510755 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1121/2251] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:10.521440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.522883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.536689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1131/2252] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:10.537968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.539819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.552549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610c870-d146-41e8-9896-4ddb8ce3c66e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.557720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.558694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.558694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.559214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.559983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.561835 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.572435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1132/2253] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:10.576917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.588853 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf12a6-20eb-4a12-b3b5-b915342266be admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.592857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ee39e-e7b7-4357-b151-08297b44562d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.595798 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.596465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.596752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.597047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.597472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba335a-bf0d-4fbf-8796-e6d264d9aee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.597700 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.598218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba335a-bf0d-4fbf-8796-e6d264d9aee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.598498 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba335a-bf0d-4fbf-8796-e6d264d9aee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.598772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba335a-bf0d-4fbf-8796-e6d264d9aee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.599384 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.608843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba335a-bf0d-4fbf-8796-e6d264d9aee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.610310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba335a-bf0d-4fbf-8796-e6d264d9aee8 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.613799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1133/2254] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:10.615021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.621218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1122/2255] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:10.626200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f63cb-bc08-4e45-ac96-2dc7ef17a809 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.631436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.632242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.632556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.632831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] PATH_INFO: `/v3/projects/fef775cf941a48c787b173df392f79d9/users/b9643af7f4e649cabd7af574e2b101ab/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.650585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef775cf941a48c787b173df392f79d9, user_id=b9643af7f4e649cabd7af574e2b101ab, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.654015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.667979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1134/2256] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:10 2022] PUT /identity/v3/projects/fef775cf941a48c787b173df392f79d9/users/b9643af7f4e649cabd7af574e2b101ab/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:10.680747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431b85-c6b9-4837-bcea-04199c661e50 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.680747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431b85-c6b9-4837-bcea-04199c661e50 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.680747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431b85-c6b9-4837-bcea-04199c661e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.682726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.686194 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.713814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b6431b85-c6b9-4837-bcea-04199c661e50 None None] MFA Rules not processed for user `b9643af7f4e649cabd7af574e2b101ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:10.715196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b6431b85-c6b9-4837-bcea-04199c661e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.760228 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d786-7f73-4efb-9da6-1656f22c68f6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.765560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.766197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.766484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.766762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] PATH_INFO: `/v3/users/862917c799b5468d89ff503416c4c37b` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.768063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=862917c799b5468d89ff503416c4c37b)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.770352 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.797780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1123/2257] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:10.799298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431b85-c6b9-4837-bcea-04199c661e50 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.814096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431b85-c6b9-4837-bcea-04199c661e50 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:10.826108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:10.827202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:10.827202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:10.827409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:10.828213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:10.830165 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:10.847190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862917c799b5468d89ff503416c4c37b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.848218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862917c799b5468d89ff503416c4c37b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.858390 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862917c799b5468d89ff503416c4c37b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.875778 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:10.878415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862917c799b5468d89ff503416c4c37b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.881509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862917c799b5468d89ff503416c4c37b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:10.887874 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1124/2258] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:10.891866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.893875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:10.907212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1135/2259] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:10 2022] DELETE /identity/v3/users/862917c799b5468d89ff503416c4c37b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:10.973630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:10.993914 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:10.996223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.000627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28816138-abd4-4262-a6f1-1ebef01d188b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.089963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.090631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.090914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.091295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.091941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.099263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.105444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8702008-663b-479e-a902-33304a4abc4c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.110581 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.111318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.111637 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.111937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] PATH_INFO: `/v3/projects/5d367460c5b0449cb31e5ebb836daf08` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.113483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d367460c5b0449cb31e5ebb836daf08)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.115650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.123028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1125/2260] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:10 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:11.126740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.142252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556cd7-47ab-485a-99c5-edff59c1408d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.149153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.150029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.150308 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.150626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.151265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.152908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.164909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1126/2261] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:11.165787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.168160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.186205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d367460c5b0449cb31e5ebb836daf08', 'request_id': 'req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.191471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d367460c5b0449cb31e5ebb836daf08', 'request_id': 'req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.192248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454771-1596-4c7f-880e-8b46288ac8a2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.202036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d367460c5b0449cb31e5ebb836daf08', 'request_id': 'req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.214400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] The token cache is being invalidate because project 5d367460c5b0449cb31e5ebb836daf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:11.214692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.215496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.217248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1136/2262] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:10 2022] DELETE /identity/v3/projects/5d367460c5b0449cb31e5ebb836daf08 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:11.217761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.219096 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.257477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.258170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.258454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.258752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] PATH_INFO: `/v3/projects/302502d41761429bbb1a0ed60ef6a1d9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.259981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=302502d41761429bbb1a0ed60ef6a1d9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.261976 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.290551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f42e2-3dcb-4a7b-bb00-5639b3db1258 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.295983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2af4-906c-4b46-89f6-26553bdb51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.296598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2af4-906c-4b46-89f6-26553bdb51d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.296885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2af4-906c-4b46-89f6-26553bdb51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.297160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2af4-906c-4b46-89f6-26553bdb51d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.297959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2af4-906c-4b46-89f6-26553bdb51d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.299925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2af4-906c-4b46-89f6-26553bdb51d5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.310707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1137/2263] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:11.311743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302502d41761429bbb1a0ed60ef6a1d9', 'request_id': 'req-c785e9b2-4981-4ad2-9c99-56938cacd6aa'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.312001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.312292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.312568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.319475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302502d41761429bbb1a0ed60ef6a1d9', 'request_id': 'req-c785e9b2-4981-4ad2-9c99-56938cacd6aa'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.327653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302502d41761429bbb1a0ed60ef6a1d9', 'request_id': 'req-c785e9b2-4981-4ad2-9c99-56938cacd6aa'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.333564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:11.334771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.338868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] The token cache is being invalidate because project 302502d41761429bbb1a0ed60ef6a1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:11.339194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.339870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.341438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1127/2264] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:11 2022] DELETE /identity/v3/projects/302502d41761429bbb1a0ed60ef6a1d9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:11.342336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.343646 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.347195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:11.353801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:11.401818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1138/2265] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:11.404029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.405463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.411509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785e9b2-4981-4ad2-9c99-56938cacd6aa admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.416234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1113-c956-4111-8c6c-10cb2e5d1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.416898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1113-c956-4111-8c6c-10cb2e5d1714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.417178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1113-c956-4111-8c6c-10cb2e5d1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.417450 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1113-c956-4111-8c6c-10cb2e5d1714 admin admin] PATH_INFO: `/v3/projects/091f97f2351147b097349344da8d6646/users/402120cf7dfa4555a6e126d34fbb9464/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.418056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ae7c-83e0-407e-9953-3208dfb53fa2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.423529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.424156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.424443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.424723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] PATH_INFO: `/v3/users/a259218548b74b50af6c14b029b8d33d` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.425869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a259218548b74b50af6c14b029b8d33d)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.427823 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.433186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1113-c956-4111-8c6c-10cb2e5d1714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091f97f2351147b097349344da8d6646, user_id=402120cf7dfa4555a6e126d34fbb9464, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.436568 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1113-c956-4111-8c6c-10cb2e5d1714 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.450485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1128/2266] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:11 2022] PUT /identity/v3/projects/091f97f2351147b097349344da8d6646/users/402120cf7dfa4555a6e126d34fbb9464/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:11.453211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd8eb-f6e3-4d7f-8fb5-276abc1a8b1d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.453506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd8eb-f6e3-4d7f-8fb5-276abc1a8b1d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.453816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cd8eb-f6e3-4d7f-8fb5-276abc1a8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.478086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-155cd8eb-f6e3-4d7f-8fb5-276abc1a8b1d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:11.479334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-155cd8eb-f6e3-4d7f-8fb5-276abc1a8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.480444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a259218548b74b50af6c14b029b8d33d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.481712 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a259218548b74b50af6c14b029b8d33d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.489529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a259218548b74b50af6c14b029b8d33d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.501973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a259218548b74b50af6c14b029b8d33d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.502667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f5578f06-f552-40bd-afe6-845257ebbc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a259218548b74b50af6c14b029b8d33d'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.516107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1139/2267] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:11 2022] DELETE /identity/v3/users/a259218548b74b50af6c14b029b8d33d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:11.517493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.517787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.518065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.550956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] MFA Rules not processed for user `402120cf7dfa4555a6e126d34fbb9464`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:11.551228 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1129/2268] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:11.551344 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.551934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd8eb-f6e3-4d7f-8fb5-276abc1a8b1d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.563688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cd8eb-f6e3-4d7f-8fb5-276abc1a8b1d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.626924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1140/2269] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:11.630312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.630799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.630938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.631263 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.631537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.632606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:11.632727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.632830 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.634115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.646855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc065-ec04-4cb4-8ad2-6aeb55b304af None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.650468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1130/2270] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:31:11.651342 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.654074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.654597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.654878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.655183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.655813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.657777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.662135 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db70d1-17e0-4452-93ee-e4821539747a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.667638 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.669173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.669468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.670059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.670380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.673445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.677325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:11.691128 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1141/2271] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:11.695763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.713417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1131/2272] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:11.714502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.720248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:11.770623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134240-6e4a-43fb-b549-75f05348bf9d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.782685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d46e42-d2ae-40d9-8609-dd7b348d438a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.787997 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.788643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.789318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.789595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.790236 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.792322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.819471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1132/2273] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:11.819471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.819471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.831358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491cd27-cb02-43fa-8a90-e8435c14a0be admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.831759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.832376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.832660 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.833058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.833701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.835748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.836227 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.836838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.837118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.837393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] PATH_INFO: `/v3/projects/130dc51763fe4f9e95837e3272d06cfd` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.838526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130dc51763fe4f9e95837e3272d06cfd)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.840489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.859802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1142/2274] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:11.859802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.867495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ceb45-6da4-4ac3-abe3-afdb5fcc4f69 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.873293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.873890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.874180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.874469 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.875135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.876725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.886728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1143/2275] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:11.888493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.893388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130dc51763fe4f9e95837e3272d06cfd', 'request_id': 'req-2f18c744-3050-40f0-acd8-2d4295875d76'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.898016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb2b8-1ca4-4df0-abac-87adfc662316 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:11.900723 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130dc51763fe4f9e95837e3272d06cfd', 'request_id': 'req-2f18c744-3050-40f0-acd8-2d4295875d76'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.908464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130dc51763fe4f9e95837e3272d06cfd', 'request_id': 'req-2f18c744-3050-40f0-acd8-2d4295875d76'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.920076 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] The token cache is being invalidate because project 130dc51763fe4f9e95837e3272d06cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:11.920369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.921022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:11.922592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1133/2276] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:11 2022] DELETE /identity/v3/projects/130dc51763fe4f9e95837e3272d06cfd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:11.924060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:11.925752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.956162 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b63943-ca51-4e16-8ac9-ac1a863a226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:11.956771 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b63943-ca51-4e16-8ac9-ac1a863a226b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.957265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b63943-ca51-4e16-8ac9-ac1a863a226b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.957529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b63943-ca51-4e16-8ac9-ac1a863a226b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.958370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b63943-ca51-4e16-8ac9-ac1a863a226b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:11.960035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b63943-ca51-4e16-8ac9-ac1a863a226b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:11.970176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1144/2277] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:11.971408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:11.971739 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:11.972012 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:11.992843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:11.994050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:11.997642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18c744-3050-40f0-acd8-2d4295875d76 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.002592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89e4d9-2238-4996-ae9f-76ae50d1144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.002763 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1145/2278] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:12.003433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.003812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e4d9-2238-4996-ae9f-76ae50d1144c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.004102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e4d9-2238-4996-ae9f-76ae50d1144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.004379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e4d9-2238-4996-ae9f-76ae50d1144c admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.005037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89e4d9-2238-4996-ae9f-76ae50d1144c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.005162 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.006829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89e4d9-2238-4996-ae9f-76ae50d1144c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.017094 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb7ad1-64af-476f-b647-d839ad3471fe None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.020806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1134/2279] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:12.020806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3a44-9ca4-42f8-a943-43a433de49a1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.020806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3a44-9ca4-42f8-a943-43a433de49a1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.020806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3a44-9ca4-42f8-a943-43a433de49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.024820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.025632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.025916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.026191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] PATH_INFO: `/v3/projects/8033028c1612405f907135c4f45ca502/users/dd205306f49740dd966c21d6b78df9dd/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.036057 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:12.039148 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b58d3a44-9ca4-42f8-a943-43a433de49a1 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:12.040367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b58d3a44-9ca4-42f8-a943-43a433de49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.044510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8033028c1612405f907135c4f45ca502, user_id=dd205306f49740dd966c21d6b78df9dd, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.047325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.049060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1135/2280] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:12.052493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d3a44-9ca4-42f8-a943-43a433de49a1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.055627 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:12.059864 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d3a44-9ca4-42f8-a943-43a433de49a1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.064892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1146/2281] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:12 2022] PUT /identity/v3/projects/8033028c1612405f907135c4f45ca502/users/dd205306f49740dd966c21d6b78df9dd/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:12.065767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.123729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.124407 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.124699 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.124976 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] PATH_INFO: `/v3/projects/9235714ca09747a58275e32f557befb3/users/b320199614cf4d89b692badd01a97db5/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.138318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de60326-15a4-4664-8a46-4e3867b5c4c2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.141833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9235714ca09747a58275e32f557befb3, user_id=b320199614cf4d89b692badd01a97db5, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.144443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.145069 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.145194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.145492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.145624 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.146257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:12.146539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.148275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.165875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1147/2282] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:12.170604 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.179658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1136/2283] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:12 2022] PUT /identity/v3/projects/9235714ca09747a58275e32f557befb3/users/b320199614cf4d89b692badd01a97db5/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:12.186329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62781c-138e-498b-b19a-794dde468f8d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.188144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.274593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead4ec1-74c3-436e-8b7d-7297ccb7df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.274797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f40e-0a77-4693-a052-d251aeb7759f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.275564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4ec1-74c3-436e-8b7d-7297ccb7df17 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.275924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4ec1-74c3-436e-8b7d-7297ccb7df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.276440 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4ec1-74c3-436e-8b7d-7297ccb7df17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.277173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4ec1-74c3-436e-8b7d-7297ccb7df17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.279821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4ec1-74c3-436e-8b7d-7297ccb7df17 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.282634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.283327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.283674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.284012 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.284918 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.287015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.295983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1148/2284] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:12.295983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.295983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.295983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.319464 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:12.321325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.323303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1137/2285] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:12 2022] POST /identity/v3/projects => generated 399 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:12.327957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.394797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1149/2286] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:12.395937 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.397392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.404109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16dbbe-bd16-4ad4-9c0f-437f2596116c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.409380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.409941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.410218 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.410493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] PATH_INFO: `/v3/projects/8033028c1612405f907135c4f45ca502/users/dd205306f49740dd966c21d6b78df9dd/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.412496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8033028c1612405f907135c4f45ca502, user_id=dd205306f49740dd966c21d6b78df9dd, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.415256 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.420285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:12.428400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1138/2287] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:12 2022] PUT /identity/v3/projects/8033028c1612405f907135c4f45ca502/users/dd205306f49740dd966c21d6b78df9dd/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:12.429210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.441809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:12.481174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b948b20-e2d1-4981-b1a2-3d0d3874a5a5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.498322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a521c1d-7147-4d2a-8125-80c4ac70a62a admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.503152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.503791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.504064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.504334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.504963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.506878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.535749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1139/2288] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:12 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:12.535749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.537159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.540894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01f234-84cb-47e5-ad16-49971bc98cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.541519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f234-84cb-47e5-ad16-49971bc98cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.541924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f234-84cb-47e5-ad16-49971bc98cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.542077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f234-84cb-47e5-ad16-49971bc98cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.543866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0b01f234-84cb-47e5-ad16-49971bc98cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.550155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017cfe2-4877-487d-8507-8e7abc507616 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.553970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.554772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.555254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.555535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.557572 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01f234-84cb-47e5-ad16-49971bc98cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.560673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01f234-84cb-47e5-ad16-49971bc98cd5 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.566947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.568503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.572100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1150/2289] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:12.573320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.573708 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.574091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.580043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1140/2290] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:12.581147 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.593262 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549766-c029-4aff-b780-2ce5d4512bd6 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.599667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.600556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.600994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.601462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.602270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.604232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.610011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] MFA Rules not processed for user `dd205306f49740dd966c21d6b78df9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:12.611494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.623398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1141/2291] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:12.624657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.636095 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c25b-e2c7-4744-adfc-05a292f1bd41 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.642692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.643468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.644021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.644239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.645009 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.646907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.661831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1142/2292] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:12.663500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.676892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001adbf-aeb8-4e72-82fc-347aaadd7a8e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.685010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c06e7-1e48-4045-9a14-76b2206456bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.686334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c06e7-1e48-4045-9a14-76b2206456bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.686692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c06e7-1e48-4045-9a14-76b2206456bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.687032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c06e7-1e48-4045-9a14-76b2206456bd admin admin] PATH_INFO: `/v3/projects/83a96301353947bfb0c9a0e93079256f/users/d33d5980841745b2b07b72523f0e8466/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.704629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1151/2293] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:12.715657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c06e7-1e48-4045-9a14-76b2206456bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a96301353947bfb0c9a0e93079256f, user_id=d33d5980841745b2b07b72523f0e8466, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:12.718017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.720247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c06e7-1e48-4045-9a14-76b2206456bd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:12.720427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.742545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1143/2294] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:12 2022] PUT /identity/v3/projects/83a96301353947bfb0c9a0e93079256f/users/d33d5980841745b2b07b72523f0e8466/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:12.755254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3240d-0ad7-4d83-92c1-2c55ebcf8c88 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.755614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3240d-0ad7-4d83-92c1-2c55ebcf8c88 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.755957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3240d-0ad7-4d83-92c1-2c55ebcf8c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.804586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0ec3240d-0ad7-4d83-92c1-2c55ebcf8c88 None None] MFA Rules not processed for user `d33d5980841745b2b07b72523f0e8466`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:12.804586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0ec3240d-0ad7-4d83-92c1-2c55ebcf8c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:12.835512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8c9df-00d8-4d0e-a2c0-47b534413610 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:12.854075 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:12.923838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:12.925583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:12.926036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:12.926584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:12.928229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1144/2295] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:12.935212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3240d-0ad7-4d83-92c1-2c55ebcf8c88 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:12.997789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:13.051176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:13.052877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:13.061788 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3240d-0ad7-4d83-92c1-2c55ebcf8c88 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:13.068050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:13.068816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:13.069103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:13.069385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:13.070066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:13.072049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:13.079995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1152/2296] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:13.109754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1145/2297] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:12 2022] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:13.114432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:13.129508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c6b5c-0e09-413a-92a1-3cff411e2804 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:13.229592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:13.231556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:13.234713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:13.236909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:13.237839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:13.243173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:13.298493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1153/2298] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:13 2022] POST /identity/v3/users => generated 307 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:13.300491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:13.313740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbf17-7f16-4633-8c67-5038c1f71d13 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:13.319056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:13.319868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:13.320321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:13.320745 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:13.322462 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:13.325636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:13.345562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1146/2299] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:13.349884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:13.366260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9c6b-8a0b-4239-bf82-5beb4f3e8984 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:13.370971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:13.372033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:13.372421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:13.373130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] PATH_INFO: `/v3/projects/3ebf51ab6d354e0091c76019b73c2cf7/users/1dd987c1f8c34d61b4b1d95b324722fb/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:13.393718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf51ab6d354e0091c76019b73c2cf7, user_id=1dd987c1f8c34d61b4b1d95b324722fb, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:13.396885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:13.425654 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1154/2300] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:13 2022] PUT /identity/v3/projects/3ebf51ab6d354e0091c76019b73c2cf7/users/1dd987c1f8c34d61b4b1d95b324722fb/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:13.430230 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:13.447022 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592efdb2-3b42-4a86-964d-18691eababb3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:13.591651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55538ca6-4ba0-4127-acc9-e9e069196889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:13.592408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55538ca6-4ba0-4127-acc9-e9e069196889 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:13.592791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55538ca6-4ba0-4127-acc9-e9e069196889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:13.593271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55538ca6-4ba0-4127-acc9-e9e069196889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:13.595475 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55538ca6-4ba0-4127-acc9-e9e069196889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:13.599512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55538ca6-4ba0-4127-acc9-e9e069196889 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:13.627737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1147/2301] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:13.628916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:13.647392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e51d3-ba5a-4557-a6d9-b1c594012ea9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:13.658592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:13.659386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:13.659691 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:13.660800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] PATH_INFO: `/v3/projects/3ebf51ab6d354e0091c76019b73c2cf7/users/1dd987c1f8c34d61b4b1d95b324722fb/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:13.664049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf51ab6d354e0091c76019b73c2cf7, user_id=1dd987c1f8c34d61b4b1d95b324722fb, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:13.667052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:13.690609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1155/2302] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:13 2022] PUT /identity/v3/projects/3ebf51ab6d354e0091c76019b73c2cf7/users/1dd987c1f8c34d61b4b1d95b324722fb/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:13.692311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b807-53c9-4b80-a567-4577545bec1d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:13.692624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b807-53c9-4b80-a567-4577545bec1d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:13.692904 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b807-53c9-4b80-a567-4577545bec1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:13.730055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-3844b807-53c9-4b80-a567-4577545bec1d None None] MFA Rules not processed for user `1dd987c1f8c34d61b4b1d95b324722fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:13.731705 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-3844b807-53c9-4b80-a567-4577545bec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:13.830582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1148/2303] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:13 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:13.844874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:13.846800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:13.889720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:13.929064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844b807-53c9-4b80-a567-4577545bec1d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:13.974790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:13.988944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572fe8-6a51-4f94-ad9e-4a88629cd3d2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:13.999318 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:14.002744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:14.003236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:14.003760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:14.023565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:14.025366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:14.041374 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844b807-53c9-4b80-a567-4577545bec1d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:14.047646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1156/2304] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:13 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:14.049669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:14.050404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:14.050818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:14.051224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:14.053378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:14.153556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:14.155469 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:14.177210 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:14.188287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f162115-a979-4abc-9a01-aef8d0d857c8 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:14.197510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1149/2305] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:14.200084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68987b31-ce51-4206-92cc-125909021f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:14.200918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987b31-ce51-4206-92cc-125909021f2d service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:14.201372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987b31-ce51-4206-92cc-125909021f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:14.201645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987b31-ce51-4206-92cc-125909021f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:14.300477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68987b31-ce51-4206-92cc-125909021f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:14.306923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68987b31-ce51-4206-92cc-125909021f2d service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:14.327659 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1157/2306] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:17.816340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:17.818058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:18.080068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee66dd8-6a36-47e1-a297-2551aa4dd72a service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:18.131809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:18.132809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:18.133234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:18.133493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] PATH_INFO: `/v3/users/8f85c5d88c324fd790b6282e714861de` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:18.139146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f85c5d88c324fd790b6282e714861de)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:18.146177 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:18.282155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f85c5d88c324fd790b6282e714861de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.282913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f85c5d88c324fd790b6282e714861de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.299156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f85c5d88c324fd790b6282e714861de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.317361 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f85c5d88c324fd790b6282e714861de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.337543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:18.339452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f85c5d88c324fd790b6282e714861de'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.354353 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1150/2307] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:17 2022] DELETE /identity/v3/users/8f85c5d88c324fd790b6282e714861de => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:18.609032 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:18.609551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:18.609655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:18.653294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:18.656249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:18.685726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] MFA Rules not processed for user `b320199614cf4d89b692badd01a97db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:18.687265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:18.776987 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917186f-7975-4bab-bc94-d7e0d7706e46 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:18.782386 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:18.783560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:18.783949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:18.784333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] PATH_INFO: `/v3/projects/47e88d0765204d839d08bccfc54d596a` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:18.785495 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1158/2308] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:18.787701 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e88d0765204d839d08bccfc54d596a)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:18.789625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:18.790608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:18.791233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:18.813383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b698d0c-2758-4d11-8e2f-6066687535c8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:18.818521 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:18.819957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:18.820278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:18.820683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:18.821408 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:18.825523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:18.867073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1159/2309] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:18 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:18.868693 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:18.871824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e88d0765204d839d08bccfc54d596a', 'request_id': 'req-c146578c-c1af-400a-81cc-962c611e1491'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.880025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e88d0765204d839d08bccfc54d596a', 'request_id': 'req-c146578c-c1af-400a-81cc-962c611e1491'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.894347 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e88d0765204d839d08bccfc54d596a', 'request_id': 'req-c146578c-c1af-400a-81cc-962c611e1491'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.910180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] The token cache is being invalidate because project 47e88d0765204d839d08bccfc54d596a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:18.910460 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.915928 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c146578c-c1af-400a-81cc-962c611e1491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:18.918536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1151/2310] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:18 2022] DELETE /identity/v3/projects/47e88d0765204d839d08bccfc54d596a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:18.926562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985743e-68b8-4746-91da-ec4b6755011e None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:18.926852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985743e-68b8-4746-91da-ec4b6755011e None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:18.927178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985743e-68b8-4746-91da-ec4b6755011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:18.932815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:18.970106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-8985743e-68b8-4746-91da-ec4b6755011e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:18.978733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8985743e-68b8-4746-91da-ec4b6755011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.001674 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1152/2311] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:19.003542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7566-58c3-4e70-b84b-6bddc2f2e0e3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.003925 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7566-58c3-4e70-b84b-6bddc2f2e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.004221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7566-58c3-4e70-b84b-6bddc2f2e0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.011065 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b64f8-3cc6-4bf4-ba23-a1ba11cc6a7b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.026343 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.027047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.030405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-be9f7566-58c3-4e70-b84b-6bddc2f2e0e3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:19.030873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.031329 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.031663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-be9f7566-58c3-4e70-b84b-6bddc2f2e0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.032534 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.036001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.046966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1153/2312] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:19.054857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f7566-58c3-4e70-b84b-6bddc2f2e0e3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.069381 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1160/2313] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:18 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:19.073504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f7566-58c3-4e70-b84b-6bddc2f2e0e3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.074678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.079368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.082341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.083130 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.083688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.084029 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.084993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:19.085459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.087530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.098646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfceac-1584-4cf9-b6df-5663e28c22ff admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.103205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1154/2314] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:19.107662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.109541 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.110176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.110465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.110886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.111567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.113195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.119153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfff3a3-0a1a-46a9-8b51-5a192bf9d6fd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.128060 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.129203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.129838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.130994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.131944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.134146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.136448 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1161/2315] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:19.141103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.157392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4985-6ebe-44d9-b446-9b254764e569 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.172159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.172900 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.173501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.173777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] PATH_INFO: `/v3/projects/496f711c68f04ec0b707f294f6ba23ef/users/678c86c0225d4a4a9de072dc30709de7/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.196117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1155/2316] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:19.197597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.201595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] RBAC: Authorizing `identity:create_grant(project_id=496f711c68f04ec0b707f294f6ba23ef, user_id=678c86c0225d4a4a9de072dc30709de7, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.207799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.229704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1162/2317] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:19 2022] PUT /identity/v3/projects/496f711c68f04ec0b707f294f6ba23ef/users/678c86c0225d4a4a9de072dc30709de7/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:19.234709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.281105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:19.320925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd1fe-c173-45b8-ab51-59451242252d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.321373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679287-1aff-4c62-b4d3-f649880dcfbd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.333601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.334993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.335396 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.335766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.336490 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.337291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.337564 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.337866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.338614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.340585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.343709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.345477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.362468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1163/2318] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:19.362468 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.363244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.380059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1156/2319] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:19 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:19.380910 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.399953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ed8f4-3aa1-4688-8335-e6b6112023ba admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.413373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.414121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.414467 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.414857 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] PATH_INFO: `/v3/projects/496f711c68f04ec0b707f294f6ba23ef/users/678c86c0225d4a4a9de072dc30709de7/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.417377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496f711c68f04ec0b707f294f6ba23ef, user_id=678c86c0225d4a4a9de072dc30709de7, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.424223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.446447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1157/2320] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:19 2022] PUT /identity/v3/projects/496f711c68f04ec0b707f294f6ba23ef/users/678c86c0225d4a4a9de072dc30709de7/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:19.447365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.477540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28f7f-2235-47f6-8953-524c8865dee8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.539391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:19.554247 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fd1da-7db5-4886-87a6-0067b9663b14 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.569291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.570506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.570838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.571472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.574388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.579319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.580152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.580587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.580963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.582524 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.585598 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.608824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1158/2321] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:19.612913 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.633358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550f9c2-c13c-4ebe-ba82-e6d62f395427 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.638840 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.639585 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.640292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.640292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.641156 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.642984 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.662956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.664438 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.665055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1159/2322] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:19.666964 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.671356 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.675974 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1164/2323] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:19.677073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.689418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5427b-f5cc-4109-8b85-3ba1e8f737bb service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.694533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184adfa-d41a-4c2f-af44-1850b3d19fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.695480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184adfa-d41a-4c2f-af44-1850b3d19fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.695598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184adfa-d41a-4c2f-af44-1850b3d19fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.695875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184adfa-d41a-4c2f-af44-1850b3d19fc6 admin admin] PATH_INFO: `/v3/projects/ee949264d4ef41b0b07b7c1844b0c6b9/users/607c9e5a329d4f65afde541756a6566c/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.710045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34ac3f-8107-4455-ac81-908130db24ce admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:19.714808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184adfa-d41a-4c2f-af44-1850b3d19fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee949264d4ef41b0b07b7c1844b0c6b9, user_id=607c9e5a329d4f65afde541756a6566c, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.718140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184adfa-d41a-4c2f-af44-1850b3d19fc6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.724691 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:19.725471 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.725695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.726000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] PATH_INFO: `/v3/users/d33d5980841745b2b07b72523f0e8466` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.727289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33d5980841745b2b07b72523f0e8466)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:19.729310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:19.739575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1165/2324] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:19 2022] PUT /identity/v3/projects/ee949264d4ef41b0b07b7c1844b0c6b9/users/607c9e5a329d4f65afde541756a6566c/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:19.750591 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.753465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.753465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.795060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] MFA Rules not processed for user `607c9e5a329d4f65afde541756a6566c`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:19.796605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.812708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33d5980841745b2b07b72523f0e8466'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:19.813423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33d5980841745b2b07b72523f0e8466'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:19.822477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33d5980841745b2b07b72523f0e8466'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:19.831334 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33d5980841745b2b07b72523f0e8466'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:19.859787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-2341dc60-19e8-4597-8797-d8bad0e6b860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33d5980841745b2b07b72523f0e8466'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:19.874296 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1160/2325] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:19 2022] DELETE /identity/v3/users/d33d5980841745b2b07b72523f0e8466 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:19.876352 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:19.876651 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:19.876933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:19.902895 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:19.904594 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.911291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1166/2326] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:19.916006 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:19.917463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:19.925422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:20.011752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1161/2327] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:20.014483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:20.022875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:20.024869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:20.028422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890fe7-9f74-4638-88c6-8efe0cd6bdb1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.043713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.044453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.045466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.045887 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.048247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.050671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.090839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1167/2328] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:19 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:20.094759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:20.111238 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9ea1a-1a5a-4263-9525-23f3ead03b20 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.202979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45004235-2388-40e6-82c0-836b2f3a7a31 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.215702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.217682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.217962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.218769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.219805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.222038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.225979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.226750 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.227198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.227569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.239603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.241614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.253112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1168/2329] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:20 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:20.257970 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:20.261544 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1162/2330] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:20.280058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc49946-3349-42f6-97c3-f66857d28c78 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.287625 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.288253 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.288540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.288818 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.289484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.291189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.326557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1169/2331] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:20.329971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:20.341169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8efdb-d4b7-4746-b1f0-2dbd31de85a7 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.347978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.348730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.349050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.349539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] PATH_INFO: `/v3/projects/bd261f732f1b41ee99c927bc9f4407ef/users/e5940958a80f44ecac53dfef5bd23ddc/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.396543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd261f732f1b41ee99c927bc9f4407ef, user_id=e5940958a80f44ecac53dfef5bd23ddc, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.400538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.422056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1163/2332] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:20 2022] PUT /identity/v3/projects/bd261f732f1b41ee99c927bc9f4407ef/users/e5940958a80f44ecac53dfef5bd23ddc/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:20.427177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:20.446978 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c62f-3c34-4353-8b31-f8a7594dfb1b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.582575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c1a00-2ab1-4042-ba43-4537e8930888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.583324 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1a00-2ab1-4042-ba43-4537e8930888 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.583610 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1a00-2ab1-4042-ba43-4537e8930888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.583886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c1a00-2ab1-4042-ba43-4537e8930888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.584638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c1a00-2ab1-4042-ba43-4537e8930888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.586627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c1a00-2ab1-4042-ba43-4537e8930888 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.599537 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1170/2333] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:20.603292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:20.620405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fba7b-db05-418d-9e65-16dc903f0869 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.625735 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.626562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.634536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.635150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] PATH_INFO: `/v3/projects/bd261f732f1b41ee99c927bc9f4407ef/users/e5940958a80f44ecac53dfef5bd23ddc/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.639191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd261f732f1b41ee99c927bc9f4407ef, user_id=e5940958a80f44ecac53dfef5bd23ddc, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.642289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.657277 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1164/2334] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:20 2022] PUT /identity/v3/projects/bd261f732f1b41ee99c927bc9f4407ef/users/e5940958a80f44ecac53dfef5bd23ddc/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:20.669728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4eeb2-d7f9-4ecd-b3d7-4692dc5401cf None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.670177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4eeb2-d7f9-4ecd-b3d7-4692dc5401cf None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.670298 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4eeb2-d7f9-4ecd-b3d7-4692dc5401cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.706083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-85a4eeb2-d7f9-4ecd-b3d7-4692dc5401cf None None] MFA Rules not processed for user `e5940958a80f44ecac53dfef5bd23ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:20.707873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-85a4eeb2-d7f9-4ecd-b3d7-4692dc5401cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:20.782833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:20.819122 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1171/2335] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:20.831850 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:20.833668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:20.877301 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:20.911485 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66477-19e9-48d0-ae4f-29e572b7815d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:20.921889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f3f4f-c7ea-400a-81c0-4362f6dfce18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:20.921889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f3f4f-c7ea-400a-81c0-4362f6dfce18 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:20.921889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f3f4f-c7ea-400a-81c0-4362f6dfce18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:20.922417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f3f4f-c7ea-400a-81c0-4362f6dfce18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:20.936538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f3f4f-c7ea-400a-81c0-4362f6dfce18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:20.938215 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f3f4f-c7ea-400a-81c0-4362f6dfce18 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:20.951685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1165/2336] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:20.991226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4eeb2-d7f9-4ecd-b3d7-4692dc5401cf None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:21.076672 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4eeb2-d7f9-4ecd-b3d7-4692dc5401cf None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:21.081988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:21.082570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:21.082854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:21.083182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] PATH_INFO: `/v3/users/607c9e5a329d4f65afde541756a6566c` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:21.084359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607c9e5a329d4f65afde541756a6566c)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:21.086309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:21.145883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607c9e5a329d4f65afde541756a6566c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.146548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607c9e5a329d4f65afde541756a6566c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.158074 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607c9e5a329d4f65afde541756a6566c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.194039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607c9e5a329d4f65afde541756a6566c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.196014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607c9e5a329d4f65afde541756a6566c'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.209274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1172/2337] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:20 2022] DELETE /identity/v3/users/607c9e5a329d4f65afde541756a6566c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:21.213849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:21.214325 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:21.215529 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:21.235713 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:21.238868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:21.248679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:21.252025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:21.335662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1166/2338] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:21.356213 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:21.356986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6d3d-882d-4c81-8d9d-75a052aa9234 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:21.358825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:21.362891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:21.363664 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:21.364013 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:21.364356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] PATH_INFO: `/v3/projects/83a96301353947bfb0c9a0e93079256f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:21.365616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a96301353947bfb0c9a0e93079256f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:21.367706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:21.369832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:21.451226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a96301353947bfb0c9a0e93079256f', 'request_id': 'req-65a23eba-b151-449a-9644-e5ccf0ace116'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.458092 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a96301353947bfb0c9a0e93079256f', 'request_id': 'req-65a23eba-b151-449a-9644-e5ccf0ace116'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.458287 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589273fd-b30c-43ad-b320-72b8039fb7e3 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:21.464716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a96301353947bfb0c9a0e93079256f', 'request_id': 'req-65a23eba-b151-449a-9644-e5ccf0ace116'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.486701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] The token cache is being invalidate because project 83a96301353947bfb0c9a0e93079256f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:21.488241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.489247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.492394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1173/2339] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:21 2022] DELETE /identity/v3/projects/83a96301353947bfb0c9a0e93079256f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:21.497891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:21.501091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:21.546201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:21.548694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:21.549385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:21.549811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:21.552949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:21.590407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a23eba-b151-449a-9644-e5ccf0ace116 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:21.596193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:21.596954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:21.597250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:21.597516 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] PATH_INFO: `/v3/users/1dd987c1f8c34d61b4b1d95b324722fb` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:21.598701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd987c1f8c34d61b4b1d95b324722fb)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:21.601943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:21.626426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:21.655198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:21.656827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:21.676728 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd987c1f8c34d61b4b1d95b324722fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.677993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd987c1f8c34d61b4b1d95b324722fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.690522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd987c1f8c34d61b4b1d95b324722fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.695432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1167/2340] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:21.709730 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd987c1f8c34d61b4b1d95b324722fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.710994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd987c1f8c34d61b4b1d95b324722fb'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:21.738064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1174/2341] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:21 2022] DELETE /identity/v3/users/1dd987c1f8c34d61b4b1d95b324722fb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:22.349307 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:22.354796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:22.357626 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:22.373446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebe38e-14ca-428b-823e-0cc56791651c service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:22.380734 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:22.538009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566703a0-ffc8-49f5-9c90-91f748d33bb9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:22.570241 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:22.570912 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:22.571214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:22.575872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] PATH_INFO: `/v3/projects/ee949264d4ef41b0b07b7c1844b0c6b9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:22.578293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee949264d4ef41b0b07b7c1844b0c6b9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:22.586783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:22.612309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:22.614015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:22.614537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:22.615286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] PATH_INFO: `/v3/projects/3ebf51ab6d354e0091c76019b73c2cf7` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:22.616935 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebf51ab6d354e0091c76019b73c2cf7)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:22.619500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:22.707814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebf51ab6d354e0091c76019b73c2cf7', 'request_id': 'req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.717920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebf51ab6d354e0091c76019b73c2cf7', 'request_id': 'req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.730576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebf51ab6d354e0091c76019b73c2cf7', 'request_id': 'req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.748410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] The token cache is being invalidate because project 3ebf51ab6d354e0091c76019b73c2cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:22.749181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.750401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.753645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee949264d4ef41b0b07b7c1844b0c6b9', 'request_id': 'req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.754884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1168/2342] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:22 2022] DELETE /identity/v3/projects/3ebf51ab6d354e0091c76019b73c2cf7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:22.755888 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:22.767041 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:22.770525 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee949264d4ef41b0b07b7c1844b0c6b9', 'request_id': 'req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.787748 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee949264d4ef41b0b07b7c1844b0c6b9', 'request_id': 'req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.814123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] The token cache is being invalidate because project ee949264d4ef41b0b07b7c1844b0c6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:22.814586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.815427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-e34f8b8c-09ee-4e31-b1c6-2eb33be1f9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:22.817374 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1175/2343] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:22 2022] DELETE /identity/v3/projects/ee949264d4ef41b0b07b7c1844b0c6b9 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:22.818465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:22.818745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:22.819020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:22.847480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:22.847480 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:22.945415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1f3bf-d30d-4055-afb4-8d8a35e958ef admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:23.018529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1176/2344] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:23.025231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:23.025457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:23.026628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:23.067662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565a347-0b8d-4fb6-ae89-fb8ea9e5c6b2 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:23.079701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:23.080614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.080905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.081585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] PATH_INFO: `/v3/users/e5940958a80f44ecac53dfef5bd23ddc` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.082596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5940958a80f44ecac53dfef5bd23ddc)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:23.084910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:23.151644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:23.152369 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.153814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.161543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] PATH_INFO: `/v3/users/b9643af7f4e649cabd7af574e2b101ab` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.164966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9643af7f4e649cabd7af574e2b101ab)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:23.170284 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:23.187891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:23.216597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5940958a80f44ecac53dfef5bd23ddc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.222439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5940958a80f44ecac53dfef5bd23ddc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.236725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5940958a80f44ecac53dfef5bd23ddc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.278871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5940958a80f44ecac53dfef5bd23ddc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.280020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-09b1e673-f62c-49a5-bfe2-89d5c5389dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5940958a80f44ecac53dfef5bd23ddc'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.289043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9643af7f4e649cabd7af574e2b101ab'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.289666 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9643af7f4e649cabd7af574e2b101ab'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.310031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9643af7f4e649cabd7af574e2b101ab'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.328794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1177/2345] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:23 2022] DELETE /identity/v3/users/e5940958a80f44ecac53dfef5bd23ddc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:23.330029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7441-1272-4106-9260-ed9f3ad09543 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.330423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7441-1272-4106-9260-ed9f3ad09543 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.330802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7441-1272-4106-9260-ed9f3ad09543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.341562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9643af7f4e649cabd7af574e2b101ab'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.376647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-5e8fe6f1-dbe6-4822-af50-a0bd0f34781c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9643af7f4e649cabd7af574e2b101ab'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:23.392184 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f77c7441-1272-4106-9260-ed9f3ad09543 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:23.395759 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f77c7441-1272-4106-9260-ed9f3ad09543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:23.396252 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1169/2346] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:22 2022] DELETE /identity/v3/users/b9643af7f4e649cabd7af574e2b101ab => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:23.401468 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.401756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.402033 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.455625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:23.458811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:23.582876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1178/2347] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:23.584082 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7441-1272-4106-9260-ed9f3ad09543 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:23.600195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7441-1272-4106-9260-ed9f3ad09543 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:23.616949 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:23.617828 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.618215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.618866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.619690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:23.620089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:23.621873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:23.639738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1179/2348] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:23.641858 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:23.659874 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cfeef-45b3-4c90-9afa-f520acaafdd4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:23.661013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1170/2349] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:23.687765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:23.688502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.688898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.689274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.690031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:23.692463 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:23.695824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:23.697505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:23.739795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1180/2350] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:23 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:23.743274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:23.836123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee262003-fe38-466c-9d4c-c71cfcb74732 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:23.836993 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:23.851437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:23.852215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.852616 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.852945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.853670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:23.857264 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:23.872505 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784df628-cc20-4945-b85c-5c817ecac210 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:23.913050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1181/2351] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:23 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:23.916881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:23.946842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc1f80-fd91-49af-8e71-b8ec0b9bc24d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:23.959512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:23.960443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:23.960951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:23.961569 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:23.963892 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:23.967037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:23.969680 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:23.985239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1182/2352] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:23.990037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.006504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3569d0-3cfb-4dda-944d-b14ebb23d8a4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:24.007780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:24.011198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.012015 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.012309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.017922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:24.018755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.019370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.019821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.020760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:24.023314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:24.050401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:24.053121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:24.061433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1183/2353] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:24.068960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.095429 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1171/2354] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:24.096617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.099243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:24.099711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885617-1290-4b92-beef-75011f17d368 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:24.120376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26f55-97c4-4c34-8eec-61a3332772c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:24.121103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26f55-97c4-4c34-8eec-61a3332772c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.121383 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26f55-97c4-4c34-8eec-61a3332772c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.121656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26f55-97c4-4c34-8eec-61a3332772c5 admin admin] PATH_INFO: `/v3/projects/53dc4317da7c427dabee2f9f068a943f/users/d2d4f501c728493782b6ae06e7a0bfdd/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.130996 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abbb78-c2c5-488e-99db-ef110fe7e527 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:24.137926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:24.140424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.140943 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.141445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] PATH_INFO: `/v3/projects/bd261f732f1b41ee99c927bc9f4407ef` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.144938 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd261f732f1b41ee99c927bc9f4407ef)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:24.147786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:24.163856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26f55-97c4-4c34-8eec-61a3332772c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53dc4317da7c427dabee2f9f068a943f, user_id=d2d4f501c728493782b6ae06e7a0bfdd, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:24.170049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26f55-97c4-4c34-8eec-61a3332772c5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:24.220533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1184/2355] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:24 2022] PUT /identity/v3/projects/53dc4317da7c427dabee2f9f068a943f/users/d2d4f501c728493782b6ae06e7a0bfdd/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:24.233492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.233492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.234186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.257481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd261f732f1b41ee99c927bc9f4407ef', 'request_id': 'req-4263bea4-1373-4738-9eb6-702385ca458d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:24.266006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd261f732f1b41ee99c927bc9f4407ef', 'request_id': 'req-4263bea4-1373-4738-9eb6-702385ca458d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:24.293893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd261f732f1b41ee99c927bc9f4407ef', 'request_id': 'req-4263bea4-1373-4738-9eb6-702385ca458d'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:24.312244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] MFA Rules not processed for user `d2d4f501c728493782b6ae06e7a0bfdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:24.319211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:24.324061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] The token cache is being invalidate because project bd261f732f1b41ee99c927bc9f4407ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:24.324465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:24.325953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-4263bea4-1373-4738-9eb6-702385ca458d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:24.327866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1172/2356] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:24 2022] DELETE /identity/v3/projects/bd261f732f1b41ee99c927bc9f4407ef => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:24.334596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3a7a6-987a-4f3a-b159-b6ad98256008 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.335685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3a7a6-987a-4f3a-b159-b6ad98256008 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.336019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3a7a6-987a-4f3a-b159-b6ad98256008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.389196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cad3a7a6-987a-4f3a-b159-b6ad98256008 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:24.392697 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cad3a7a6-987a-4f3a-b159-b6ad98256008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:24.479313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1185/2357] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:24.484191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.487727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:24.544317 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1173/2358] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:24.554489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef91e8-ac68-438f-ad39-7065f605cf8f None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.554789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef91e8-ac68-438f-ad39-7065f605cf8f None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.555070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef91e8-ac68-438f-ad39-7065f605cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.612377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-6aef91e8-ac68-438f-ad39-7065f605cf8f None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:24.614327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6aef91e8-ac68-438f-ad39-7065f605cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:24.626322 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1174/2359] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:24.631852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef91e8-ac68-438f-ad39-7065f605cf8f None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.651409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef91e8-ac68-438f-ad39-7065f605cf8f None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:24.660204 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:24.661138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.661493 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.661828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.662557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:24.662979 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5a4af-d5f4-467b-b4bc-b59ee40f7aee None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:24.663331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:24.666474 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:24.677076 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:24.677638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.677921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.678199 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.678855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:24.681117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:24.708053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1175/2360] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:24.709286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.716167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:24.726949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6631cd-8589-46b9-8374-40f80b8009b9 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:24.750422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:24.751050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:24.751488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:24.751803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:24.752416 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:24.754488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:24.757627 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1186/2361] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:24 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:24.762720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.820187 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1176/2362] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:24 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:24.821269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:24.868744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:24.938688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd0ad0-8116-4f98-9bcb-a3a2e5043eca admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:24.992197 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a31f-eb8e-44c1-bac0-064ee285a35d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.011681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.013176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.013573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.013944 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.014974 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.017809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.063877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1177/2363] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:24 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:25.068377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.070853 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:25.101462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.102288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.102641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.103030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.103775 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.106386 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.110005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a23d-48d3-4468-8a47-bd9ec995fa81 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.124875 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.125626 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.126112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.126237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] PATH_INFO: `/v3/projects/fef775cf941a48c787b173df392f79d9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.130567 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef775cf941a48c787b173df392f79d9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.135640 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.177441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1187/2364] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:24 2022] POST /identity/v3/users => generated 300 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:25.179484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.227462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d707-64b1-4235-b29d-629c6bcb3f7e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.254902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef775cf941a48c787b173df392f79d9', 'request_id': 'req-c0db41db-cd15-4023-98e5-45a70d1e62bd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.268071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef775cf941a48c787b173df392f79d9', 'request_id': 'req-c0db41db-cd15-4023-98e5-45a70d1e62bd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.284982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef775cf941a48c787b173df392f79d9', 'request_id': 'req-c0db41db-cd15-4023-98e5-45a70d1e62bd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.303112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] The token cache is being invalidate because project fef775cf941a48c787b173df392f79d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:25.305645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.307560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.318549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1178/2365] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:25 2022] DELETE /identity/v3/projects/fef775cf941a48c787b173df392f79d9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:25.319496 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.323538 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:25.367031 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.368099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.368938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.369483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.370522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.372703 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.386811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1188/2366] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:25.388182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.392640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:25.417167 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f406bee-ef60-482f-b6f8-dd15d36eff0e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.426732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.429091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.431461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.432055 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] PATH_INFO: `/v3/users/402120cf7dfa4555a6e126d34fbb9464` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.435110 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=402120cf7dfa4555a6e126d34fbb9464)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.438505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.455952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:25.478071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db41db-cd15-4023-98e5-45a70d1e62bd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.486151 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.487159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.487546 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.487915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.489120 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.490494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.505679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1179/2367] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:25.507059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.509595 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:25.539736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402120cf7dfa4555a6e126d34fbb9464'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.540596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402120cf7dfa4555a6e126d34fbb9464'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.551652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402120cf7dfa4555a6e126d34fbb9464'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.552542 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168231-ac52-4043-bb26-6565f4f1fa39 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.559186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:25.565748 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.566582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.567132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.567488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.568693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.573278 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.573704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402120cf7dfa4555a6e126d34fbb9464'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.577225 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402120cf7dfa4555a6e126d34fbb9464'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:25.598604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1180/2368] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:25.599821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.601706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1189/2369] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:25 2022] DELETE /identity/v3/users/402120cf7dfa4555a6e126d34fbb9464 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:25.602075 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:25.602523 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.605898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:25.619845 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852b2df-0806-49c7-8f5a-6da12d43f3cb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.738786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.739495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.739770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.740202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] PATH_INFO: `/v3/projects/320c336d08f64b1889e8be59e016e1f5/users/d47231917dc94d59bd2a24c203e95148/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.751920 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff3c6-948c-4bd8-ad01-5e6338058a7a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.765795 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf7d95-5315-4ebd-9c2a-682d48f6ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:25.767599 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf7d95-5315-4ebd-9c2a-682d48f6ffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.768563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf7d95-5315-4ebd-9c2a-682d48f6ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.769389 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf7d95-5315-4ebd-9c2a-682d48f6ffe1 admin admin] PATH_INFO: `/v3/projects/a042f37ddc6643669c1ed03cda61814c/users/0635b1d57a4d4fa7bb87079b88ebe09f/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.777783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=320c336d08f64b1889e8be59e016e1f5, user_id=d47231917dc94d59bd2a24c203e95148, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.785881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.814174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf7d95-5315-4ebd-9c2a-682d48f6ffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a042f37ddc6643669c1ed03cda61814c, user_id=0635b1d57a4d4fa7bb87079b88ebe09f, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:25.821969 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1181/2370] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:25 2022] PUT /identity/v3/projects/320c336d08f64b1889e8be59e016e1f5/users/d47231917dc94d59bd2a24c203e95148/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:25.824632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:25.827410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf7d95-5315-4ebd-9c2a-682d48f6ffe1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:25.858185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1190/2371] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:25 2022] PUT /identity/v3/projects/a042f37ddc6643669c1ed03cda61814c/users/0635b1d57a4d4fa7bb87079b88ebe09f/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:25.869001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643515d-65ab-4178-9206-c22bdf5f4a86 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:25.869674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643515d-65ab-4178-9206-c22bdf5f4a86 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:25.869674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643515d-65ab-4178-9206-c22bdf5f4a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:25.931055 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fcea-b046-4845-827e-2a897f3ae2ad admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:25.950270 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7643515d-65ab-4178-9206-c22bdf5f4a86 None None] MFA Rules not processed for user `0635b1d57a4d4fa7bb87079b88ebe09f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:25.952345 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7643515d-65ab-4178-9206-c22bdf5f4a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.069069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.070346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.070346 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.070537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.071246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.073003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.082955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1191/2372] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:26.083968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643515d-65ab-4178-9206-c22bdf5f4a86 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.101504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1182/2373] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:26.104387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.109681 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643515d-65ab-4178-9206-c22bdf5f4a86 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.115527 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.116261 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.116609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.117016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.117796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.118098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:26.119986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.124297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad541b-8827-4e26-b983-05de6bc47ff7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.133963 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97722-b7f8-43e2-9d00-11ad1155e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.135058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97722-b7f8-43e2-9d00-11ad1155e160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.135694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97722-b7f8-43e2-9d00-11ad1155e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.136163 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97722-b7f8-43e2-9d00-11ad1155e160 admin admin] PATH_INFO: `/v3/projects/320c336d08f64b1889e8be59e016e1f5/users/d47231917dc94d59bd2a24c203e95148/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.139584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97722-b7f8-43e2-9d00-11ad1155e160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=320c336d08f64b1889e8be59e016e1f5, user_id=d47231917dc94d59bd2a24c203e95148, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.146687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97722-b7f8-43e2-9d00-11ad1155e160 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.168289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1192/2374] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:26 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:26.185450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.185662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1183/2375] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:26 2022] PUT /identity/v3/projects/320c336d08f64b1889e8be59e016e1f5/users/d47231917dc94d59bd2a24c203e95148/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:26.190265 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5006-23d5-4f41-87cc-a5fc1a1d650a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.190619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5006-23d5-4f41-87cc-a5fc1a1d650a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.191052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5006-23d5-4f41-87cc-a5fc1a1d650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.239193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:26.246426 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-c80b5006-23d5-4f41-87cc-a5fc1a1d650a None None] MFA Rules not processed for user `d47231917dc94d59bd2a24c203e95148`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:26.247914 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c80b5006-23d5-4f41-87cc-a5fc1a1d650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.320234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49f47-c652-4dc0-81c5-f43fce168c53 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.329017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.329657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.330876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.331717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.332578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.334713 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.372727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1193/2376] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:26 2022] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:26.373546 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.375647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.393030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5babfea-41e6-4949-b157-8a090f7a5940 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.400597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.401364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.401652 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.402692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1184/2377] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:26.402814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] PATH_INFO: `/v3/projects/091f97f2351147b097349344da8d6646` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.403442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5006-23d5-4f41-87cc-a5fc1a1d650a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.407190 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=091f97f2351147b097349344da8d6646)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.409506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.416311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5006-23d5-4f41-87cc-a5fc1a1d650a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.430390 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.431110 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.431487 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.431893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.432558 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.434460 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.446494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1185/2378] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:26.447128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.450971 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.472940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091f97f2351147b097349344da8d6646', 'request_id': 'req-7bde4d38-770f-45dc-a463-2a17ff910d3b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:26.481552 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091f97f2351147b097349344da8d6646', 'request_id': 'req-7bde4d38-770f-45dc-a463-2a17ff910d3b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:26.488312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091f97f2351147b097349344da8d6646', 'request_id': 'req-7bde4d38-770f-45dc-a463-2a17ff910d3b'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:26.506160 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] The token cache is being invalidate because project 091f97f2351147b097349344da8d6646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:26.506452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:26.507164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7bde4d38-770f-45dc-a463-2a17ff910d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:26.508761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1194/2379] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:26 2022] DELETE /identity/v3/projects/091f97f2351147b097349344da8d6646 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:26.509967 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.510245 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.510519 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.529783 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445a811-8f29-4eca-a8d7-66ae429d1906 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.542306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] MFA Rules not processed for user `678c86c0225d4a4a9de072dc30709de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:26.543585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.586082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.586706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.586983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.587512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.589140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.627663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1195/2380] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:26.628308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.629648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.636425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:26.670723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:26.674696 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.676415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.688336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1186/2381] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:26.689074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.690476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.719158 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fc15b-801b-40e3-96df-72a1cade0ccd None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.727355 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.728578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.728879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.729226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] PATH_INFO: `/v3/projects/cc6ca81caf264ba8853daabc339f13f9/users/9f706b4ce0fa48848e532a868233c8a5/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.749860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6ca81caf264ba8853daabc339f13f9, user_id=9f706b4ce0fa48848e532a868233c8a5, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.753590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.769670 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1196/2382] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:26 2022] PUT /identity/v3/projects/cc6ca81caf264ba8853daabc339f13f9/users/9f706b4ce0fa48848e532a868233c8a5/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:26.773940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:26.777732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.780806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4a1bd-45f6-4e9c-b5d5-809b38c94694 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.866431 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.867115 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.867402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.868757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] PATH_INFO: `/v3/users/dd205306f49740dd966c21d6b78df9dd` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.875109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40db7-01a3-413b-92bb-095a49b7bcbc admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:26.878199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd205306f49740dd966c21d6b78df9dd)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:26.880330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:26.895121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:26.895955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:26.896427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:26.896883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:26.900983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:26.968069 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd205306f49740dd966c21d6b78df9dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:26.968786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd205306f49740dd966c21d6b78df9dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:26.985164 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd205306f49740dd966c21d6b78df9dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.007139 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:27.009586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:27.023589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd205306f49740dd966c21d6b78df9dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.034407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1197/2383] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:27.036986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:27.046019 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd205306f49740dd966c21d6b78df9dd'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.049844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:27.063956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1187/2384] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:26 2022] DELETE /identity/v3/users/dd205306f49740dd966c21d6b78df9dd => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:27.079675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb4731-8692-45eb-bd6f-d18dcf7ede57 service glance] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:27.211998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea55205-a2e2-450a-8c44-e3756f90534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:27.212690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55205-a2e2-450a-8c44-e3756f90534a admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.213021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55205-a2e2-450a-8c44-e3756f90534a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.213304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea55205-a2e2-450a-8c44-e3756f90534a admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.214208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea55205-a2e2-450a-8c44-e3756f90534a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:27.216834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea55205-a2e2-450a-8c44-e3756f90534a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:27.251152 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1198/2385] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:27.254221 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:27.255662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.278712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685ba7-d79f-44c0-b7ff-cabd37d7a8e7 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:27.289458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdefb4c-8fb9-45b1-b4b2-a31e4a835532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:27.290393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdefb4c-8fb9-45b1-b4b2-a31e4a835532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.290688 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdefb4c-8fb9-45b1-b4b2-a31e4a835532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.291032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdefb4c-8fb9-45b1-b4b2-a31e4a835532 admin admin] PATH_INFO: `/v3/projects/cc6ca81caf264ba8853daabc339f13f9/users/9f706b4ce0fa48848e532a868233c8a5/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.294340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdefb4c-8fb9-45b1-b4b2-a31e4a835532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6ca81caf264ba8853daabc339f13f9, user_id=9f706b4ce0fa48848e532a868233c8a5, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:27.299167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdefb4c-8fb9-45b1-b4b2-a31e4a835532 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:27.315650 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1188/2386] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:27 2022] PUT /identity/v3/projects/cc6ca81caf264ba8853daabc339f13f9/users/9f706b4ce0fa48848e532a868233c8a5/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:27.327042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.327365 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.327645 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.350772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.351070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.351385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.354254 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:27.418766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] MFA Rules not processed for user `9f706b4ce0fa48848e532a868233c8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:27.419068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:27.420342 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.424877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.564432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1189/2387] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:31:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:27.627295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1199/2388] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:27.638425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:27.642931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.648561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:27.649965 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.749667 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808322-81f2-4b86-963c-959e643afc5d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:27.754193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:27.754810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.755100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.755389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.756935 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5ad61-94fc-46a4-b349-e714611d5da0 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:27.761796 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:27.762426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.762711 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.762987 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] PATH_INFO: `/v3/projects/8033028c1612405f907135c4f45ca502` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.764186 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8033028c1612405f907135c4f45ca502)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:27.765406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:27.766858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:27.768217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:27.778711 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1190/2389] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:27.779764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:27.781066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.834548 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8033028c1612405f907135c4f45ca502', 'request_id': 'req-917c7982-e639-4ef5-8f68-6d6625f07e46'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.841558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8033028c1612405f907135c4f45ca502', 'request_id': 'req-917c7982-e639-4ef5-8f68-6d6625f07e46'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.849933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8033028c1612405f907135c4f45ca502', 'request_id': 'req-917c7982-e639-4ef5-8f68-6d6625f07e46'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.865293 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] The token cache is being invalidate because project 8033028c1612405f907135c4f45ca502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:27.866009 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.866838 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:27.869309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1200/2390] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:27 2022] DELETE /identity/v3/projects/8033028c1612405f907135c4f45ca502 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:27.871629 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:27.873111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.886931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36addb51-0699-4554-85c7-2765076914f3 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:27.902956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:27.929424 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:27.958710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7982-e639-4ef5-8f68-6d6625f07e46 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:27.963709 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbe5f1-d70f-4600-ba14-0916b047b6fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:27.964333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe5f1-d70f-4600-ba14-0916b047b6fd service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.964531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:27.964670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe5f1-d70f-4600-ba14-0916b047b6fd service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.964903 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe5f1-d70f-4600-ba14-0916b047b6fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.965173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:27.965465 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:27.965742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] PATH_INFO: `/v3/users/d2d4f501c728493782b6ae06e7a0bfdd` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:27.966716 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-bcfbe5f1-d70f-4600-ba14-0916b047b6fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:27.966925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d4f501c728493782b6ae06e7a0bfdd)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:27.968873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.019736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d4f501c728493782b6ae06e7a0bfdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.020424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d4f501c728493782b6ae06e7a0bfdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.027951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d4f501c728493782b6ae06e7a0bfdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.031020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbe5f1-d70f-4600-ba14-0916b047b6fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.032743 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbe5f1-d70f-4600-ba14-0916b047b6fd service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.040121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d4f501c728493782b6ae06e7a0bfdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.040903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d4f501c728493782b6ae06e7a0bfdd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.041018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1191/2391] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:31:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:31:28.042274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d8d7-e58c-4a0f-8c2d-7cf01c424ecc None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.043527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d8d7-e58c-4a0f-8c2d-7cf01c424ecc None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.044063 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d8d7-e58c-4a0f-8c2d-7cf01c424ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.061444 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1201/2392] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:27 2022] DELETE /identity/v3/users/d2d4f501c728493782b6ae06e7a0bfdd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:28.064192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.066451 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.068707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-ca88d8d7-e58c-4a0f-8c2d-7cf01c424ecc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:28.070070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ca88d8d7-e58c-4a0f-8c2d-7cf01c424ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.163196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1192/2393] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:28.163196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88ea12-9695-4cb7-85bc-ab2fa29d8e94 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.163196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88ea12-9695-4cb7-85bc-ab2fa29d8e94 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.163196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88ea12-9695-4cb7-85bc-ab2fa29d8e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.163699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763285-1c7e-43bf-a629-d8cfb963554a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.168287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.169056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.169458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.169836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] PATH_INFO: `/v3/users/0635b1d57a4d4fa7bb87079b88ebe09f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.171137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0635b1d57a4d4fa7bb87079b88ebe09f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.173457 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.192731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2b88ea12-9695-4cb7-85bc-ab2fa29d8e94 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:28.194155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2b88ea12-9695-4cb7-85bc-ab2fa29d8e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.204330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1193/2394] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:28.206245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.206532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.206831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.231832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:28.233113 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.233950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:28.242240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0635b1d57a4d4fa7bb87079b88ebe09f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.242855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1194/2395] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:28.243574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.244528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0635b1d57a4d4fa7bb87079b88ebe09f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.246324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.255639 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0635b1d57a4d4fa7bb87079b88ebe09f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.273513 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0635b1d57a4d4fa7bb87079b88ebe09f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.274373 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0635b1d57a4d4fa7bb87079b88ebe09f'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:28.295010 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1202/2396] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:28 2022] DELETE /identity/v3/users/0635b1d57a4d4fa7bb87079b88ebe09f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:28.295902 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.299982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.322178 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3c35-ba21-432e-b441-3fd38b223b5b None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.345891 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:28.395398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24286c4-3c43-41ce-9de1-2ce1db51cb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.396128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24286c4-3c43-41ce-9de1-2ce1db51cb5d service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.396484 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24286c4-3c43-41ce-9de1-2ce1db51cb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.396833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24286c4-3c43-41ce-9de1-2ce1db51cb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.398319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac88e72-f943-49fe-ba76-f18559bf9063 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.398966 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a24286c4-3c43-41ce-9de1-2ce1db51cb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.412788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.413563 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.414089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.414336 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.415018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24286c4-3c43-41ce-9de1-2ce1db51cb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.415164 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:28.415587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.416512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24286c4-3c43-41ce-9de1-2ce1db51cb5d service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.417430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.430525 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1195/2397] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:28.432273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.432569 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.432846 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.437154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1203/2398] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:28.438277 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.455968 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414937b-e6c8-45b6-8905-39ab600853e8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.461438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:28.462841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.465595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.466883 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.467249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.467529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.468173 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.471432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.474872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1196/2399] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:28.488011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.490201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.509942 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e2445-e3f7-4a93-bb08-c6261e354847 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.515717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.516376 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.516684 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.516933 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.533017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1204/2400] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:28 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:28.533199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.533199 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.537171 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.562360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1197/2401] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:28.629219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45702ba6-65aa-4785-9f04-e8fcea08dac3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.639774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.640907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.641412 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.642117 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.643072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.645667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.681421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1205/2402] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:28 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:28.686551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.702829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6621b-f305-4741-ad89-220ceaa4d270 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.716027 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.717034 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.717380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.717728 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.718452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.720430 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.745103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1198/2403] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:28.749614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.761475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf17201-9dfa-4f8a-845d-e536a2009532 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.785981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.786638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.786921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.787221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.791445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.795634 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.820602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1206/2404] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:28.824718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.841193 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f930-fc38-48d4-9314-f39e83cb8bdc admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.849594 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.850999 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.851740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.852408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.852760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.853658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] PATH_INFO: `/v3/projects/f57d6a10212246e89446d0e0b8b7dd0e/users/a15b5e98c4c843adb74b5c54c2fe8a8b/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.876021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc931c-dc88-4af3-a636-c22ee6926f0b admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:28.884606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:28.885385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:28.885725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:28.886026 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] PATH_INFO: `/v3/projects/53dc4317da7c427dabee2f9f068a943f` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:28.887635 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53dc4317da7c427dabee2f9f068a943f)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.889877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.891721 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57d6a10212246e89446d0e0b8b7dd0e, user_id=a15b5e98c4c843adb74b5c54c2fe8a8b, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:28.892111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:28.905315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:28.952117 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1199/2405] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:28 2022] PUT /identity/v3/projects/f57d6a10212246e89446d0e0b8b7dd0e/users/a15b5e98c4c843adb74b5c54c2fe8a8b/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:28.962797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:28.965815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:28.997925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53dc4317da7c427dabee2f9f068a943f', 'request_id': 'req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.010488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53dc4317da7c427dabee2f9f068a943f', 'request_id': 'req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.018501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53dc4317da7c427dabee2f9f068a943f', 'request_id': 'req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.036458 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] The token cache is being invalidate because project 53dc4317da7c427dabee2f9f068a943f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:29.036655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.037333 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03bc1ac3-5a3a-47e3-86a2-9d0736f92767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.043531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1207/2406] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:28 2022] DELETE /identity/v3/projects/53dc4317da7c427dabee2f9f068a943f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:29.044986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.045282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.045560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.092602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] MFA Rules not processed for user `a15b5e98c4c843adb74b5c54c2fe8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:29.094027 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:29.102884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60bcfa-2ff7-4c5f-8162-9967dd7f3d03 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:29.199662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:29.200472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.202046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.203020 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] PATH_INFO: `/v3/projects/a042f37ddc6643669c1ed03cda61814c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.204855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a042f37ddc6643669c1ed03cda61814c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:29.207548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:29.213769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1208/2407] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:29.215475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.216928 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:29.228168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:29.248348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d3470-adeb-4ee4-ad6b-5d097056475f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:29.268476 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a042f37ddc6643669c1ed03cda61814c', 'request_id': 'req-d7fb3a67-6d84-44d0-b756-24d3196c1db5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.277979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a042f37ddc6643669c1ed03cda61814c', 'request_id': 'req-d7fb3a67-6d84-44d0-b756-24d3196c1db5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.289274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a042f37ddc6643669c1ed03cda61814c', 'request_id': 'req-d7fb3a67-6d84-44d0-b756-24d3196c1db5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.302312 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] The token cache is being invalidate because project a042f37ddc6643669c1ed03cda61814c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:29.302883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.303795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.305767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1200/2408] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:28 2022] DELETE /identity/v3/projects/a042f37ddc6643669c1ed03cda61814c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:29.306679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.308225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:29.339944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:29.340619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.341101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.341466 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] PATH_INFO: `/v3/users/d47231917dc94d59bd2a24c203e95148` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.343045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47231917dc94d59bd2a24c203e95148)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:29.345077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:29.369288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:29.384742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3a67-6d84-44d0-b756-24d3196c1db5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:29.390408 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:29.391064 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.391447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.391816 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.392923 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:29.395026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:29.405077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47231917dc94d59bd2a24c203e95148'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.406314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47231917dc94d59bd2a24c203e95148'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.416113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47231917dc94d59bd2a24c203e95148'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.431271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1201/2409] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:29 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:29.432439 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.434426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47231917dc94d59bd2a24c203e95148'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.434664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:29.435421 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47231917dc94d59bd2a24c203e95148'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.453477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1209/2410] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:29 2022] DELETE /identity/v3/users/d47231917dc94d59bd2a24c203e95148 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:29.454505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.458213 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:29.545121 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e178d-150f-412b-b377-3b04f9743300 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:29.549300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507cc07-9733-454f-9989-cb5328a72745 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:29.555447 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:29.556308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.557276 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.557663 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.558450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:29.562125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:29.572124 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.572410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.572737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] PATH_INFO: `/v3/users/9f706b4ce0fa48848e532a868233c8a5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.573423 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:29.577771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f706b4ce0fa48848e532a868233c8a5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:29.581255 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:29.624292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1210/2411] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:29 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:29.631533 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.646426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a75ab-2648-4499-bf6f-4c11a66b06e5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:29.654208 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:29.654918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.655410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.655831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.656633 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:29.658877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:29.669042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:29.672236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1211/2412] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:29.676623 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.686021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f706b4ce0fa48848e532a868233c8a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.686708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f706b4ce0fa48848e532a868233c8a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.702865 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f706b4ce0fa48848e532a868233c8a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.704325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b9309-fc0a-4a32-8f21-ec87173d5554 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:29.714885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:29.715402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f706b4ce0fa48848e532a868233c8a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.715826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:29.716197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:29.716543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] PATH_INFO: `/v3/projects/395c337969fd4b51b86ae94ba06aae35/users/0adfc42b9d764ef38e63a2fba76ae8e3/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:29.739545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f706b4ce0fa48848e532a868233c8a5'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:29.746958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395c337969fd4b51b86ae94ba06aae35, user_id=0adfc42b9d764ef38e63a2fba76ae8e3, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:29.750064 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:29.753859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1202/2413] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:29 2022] DELETE /identity/v3/users/9f706b4ce0fa48848e532a868233c8a5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:29.770590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1212/2414] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:29 2022] PUT /identity/v3/projects/395c337969fd4b51b86ae94ba06aae35/users/0adfc42b9d764ef38e63a2fba76ae8e3/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:29.773540 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.776126 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:29.880443 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:29.882420 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:29.896449 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6778f1-d744-4c29-935d-f627d9b286f0 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.008704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:30.028463 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.029096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.029377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.029645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.030304 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.030845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4d288-78cf-45ec-849f-972a3ff73174 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.032053 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:30.043290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.044290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.047183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.048007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] PATH_INFO: `/v3/projects/320c336d08f64b1889e8be59e016e1f5` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.049535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=320c336d08f64b1889e8be59e016e1f5)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.052682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:30.054025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1203/2415] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:30.055169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:30.066273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812566b-f5de-45ca-9792-89c6bca66690 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.083532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef5dc7-760c-4081-9ead-2e77f6bff3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.084232 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5dc7-760c-4081-9ead-2e77f6bff3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.084668 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5dc7-760c-4081-9ead-2e77f6bff3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.085001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5dc7-760c-4081-9ead-2e77f6bff3eb admin admin] PATH_INFO: `/v3/projects/395c337969fd4b51b86ae94ba06aae35/users/0adfc42b9d764ef38e63a2fba76ae8e3/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.089031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef5dc7-760c-4081-9ead-2e77f6bff3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=395c337969fd4b51b86ae94ba06aae35, user_id=0adfc42b9d764ef38e63a2fba76ae8e3, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.094532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef5dc7-760c-4081-9ead-2e77f6bff3eb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:30.118859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1204/2416] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:30 2022] PUT /identity/v3/projects/395c337969fd4b51b86ae94ba06aae35/users/0adfc42b9d764ef38e63a2fba76ae8e3/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:30.130991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f60103-a8e6-4628-80fb-39778b97bbba None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.131392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f60103-a8e6-4628-80fb-39778b97bbba None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.131673 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f60103-a8e6-4628-80fb-39778b97bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.170065 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-92f60103-a8e6-4628-80fb-39778b97bbba None None] MFA Rules not processed for user `0adfc42b9d764ef38e63a2fba76ae8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:30.171787 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-92f60103-a8e6-4628-80fb-39778b97bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.174953 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '320c336d08f64b1889e8be59e016e1f5', 'request_id': 'req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.191388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '320c336d08f64b1889e8be59e016e1f5', 'request_id': 'req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.202249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '320c336d08f64b1889e8be59e016e1f5', 'request_id': 'req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.224154 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] The token cache is being invalidate because project 320c336d08f64b1889e8be59e016e1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:30.224640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.225260 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.230145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1213/2417] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:29 2022] DELETE /identity/v3/projects/320c336d08f64b1889e8be59e016e1f5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:30.230145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:30.230916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.237565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:30.295125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1205/2418] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:30.296838 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.297229 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.297877 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.326273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:30.327526 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.366049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab390c7-f776-44c0-8bc5-3b7ed5a87095 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.377127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.377839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.378072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.378347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] PATH_INFO: `/v3/projects/cc6ca81caf264ba8853daabc339f13f9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.380567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc6ca81caf264ba8853daabc339f13f9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.384244 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:30.421634 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1206/2419] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:30.423323 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:30.425451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.466056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6ca81caf264ba8853daabc339f13f9', 'request_id': 'req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.473170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6ca81caf264ba8853daabc339f13f9', 'request_id': 'req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.480705 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6ca81caf264ba8853daabc339f13f9', 'request_id': 'req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.512223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] The token cache is being invalidate because project cc6ca81caf264ba8853daabc339f13f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:30.512568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.513211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-693f1f17-a4fa-4f77-9b53-9d4a5e21ba31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:30.517278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1214/2420] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:30 2022] DELETE /identity/v3/projects/cc6ca81caf264ba8853daabc339f13f9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:30.518493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606b338-6a9d-4554-b94d-f48ed8ac9578 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.518786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606b338-6a9d-4554-b94d-f48ed8ac9578 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.519060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606b338-6a9d-4554-b94d-f48ed8ac9578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.526461 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230a8b6-2f8f-4874-bb63-d12cb7595705 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.554280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7606b338-6a9d-4554-b94d-f48ed8ac9578 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:30.556177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7606b338-6a9d-4554-b94d-f48ed8ac9578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.583090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:30.593470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.595348 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.595639 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.595917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.598907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.647753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:30.682885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.685531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:30.691918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1215/2421] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:30.693347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eb9de-67ce-420e-a868-916912e54a49 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.693735 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eb9de-67ce-420e-a868-916912e54a49 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.694115 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eb9de-67ce-420e-a868-916912e54a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.702250 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1207/2422] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:30.703336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:30.718131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd593240-6c11-417a-9f56-29251062c3d0 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.719250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-913eb9de-67ce-420e-a868-916912e54a49 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:30.720821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-913eb9de-67ce-420e-a868-916912e54a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.729358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.730986 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.731473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.732315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.733146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:30.733615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.737472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:30.743958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1216/2423] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:30.753074 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1208/2424] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:30.755291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.755685 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.756081 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.757141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:30.772138 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c820b-060a-4c93-9fed-e76982d00ff3 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.779591 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.780810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.781124 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.781543 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.782733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.784894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:30.787913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.793044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:30.817729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1217/2425] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:30.818921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:30.821357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.839009 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1209/2426] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:30 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:30.841303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:30.843639 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab55e5-1e78-4030-8d6c-ab508f9fd5fe None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.938283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.939539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.939539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.939802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.942391 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:30.968878 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c922ab-c148-4744-ab2f-2fe8eb5b4605 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:30.982722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:30.983529 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:30.983813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:30.984271 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:30.984941 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:30.985276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:30.989421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.008237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1210/2427] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:31.009076 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.029708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57097f73-6b2e-4006-b612-6e46630ba8fa admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.035879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.038102 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.043018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.044819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.044819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.045295 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.046046 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.050007 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.050411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1218/2428] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:31.051417 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.065002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b91750-c01f-46c9-87c9-7494fba31b0d service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.070215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.071290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.071290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.071504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.072143 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.075512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.119931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1211/2429] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:31 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:31.125058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.128650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1219/2430] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:31 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:31.133218 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.143234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e8d56-000c-47be-9d40-1632a8f5e747 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.193986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:31.232397 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872591fc-c5da-4155-8e1c-69c1b39632a2 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.239722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.240356 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.240653 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.240924 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.241567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.243661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.283072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1220/2431] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:31 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:31.284061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.298724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd4c80-f1e5-4153-bb6c-a7fa12416048 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.304121 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.304897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.305193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.305555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.306414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.308328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.316871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.319756 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.320698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.321330 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.322275 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.323695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1221/2432] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:31.324790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.325514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.337313 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4f08-8768-412b-b08b-593413072366 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.343982 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.345545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.345893 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.346357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.347723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.349946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.352225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1212/2433] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:31.355790 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.373000 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1222/2434] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:31.373992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.381266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6028-a392-4d70-995d-ed2991fe7845 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.393539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323ebbe-88e4-4221-8ad9-b352a000b164 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.394154 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.394779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.395059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.395358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.396101 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.397764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.405511 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:31.406214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89269d-607b-4e60-97f7-cf0ae6a906ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.406973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89269d-607b-4e60-97f7-cf0ae6a906ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.407426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89269d-607b-4e60-97f7-cf0ae6a906ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.407716 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89269d-607b-4e60-97f7-cf0ae6a906ed admin admin] PATH_INFO: `/v3/projects/fca11851ea4743408e05b3a95a3e9b17/users/7544fc1564d44db395df632467754e53/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.418501 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1213/2435] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:31.427825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.432456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89269d-607b-4e60-97f7-cf0ae6a906ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca11851ea4743408e05b3a95a3e9b17, user_id=7544fc1564d44db395df632467754e53, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.436450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89269d-607b-4e60-97f7-cf0ae6a906ed admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.457531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1223/2436] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:31 2022] PUT /identity/v3/projects/fca11851ea4743408e05b3a95a3e9b17/users/7544fc1564d44db395df632467754e53/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:31.463413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858d8ef-2282-4049-a800-8c7e45719122 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.465040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858d8ef-2282-4049-a800-8c7e45719122 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.465040 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858d8ef-2282-4049-a800-8c7e45719122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.468975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d833c4-0c10-462b-b186-1a988cbfa93f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.554622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-9858d8ef-2282-4049-a800-8c7e45719122 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:31.555993 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-9858d8ef-2282-4049-a800-8c7e45719122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:31.611573 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.613837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.614231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.614629 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] PATH_INFO: `/v3/projects/d54e9aa33042481c82e05f96b7df1c13/users/f29a499ee5764cf1b5af4ebac7cc8bbf/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.656112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54e9aa33042481c82e05f96b7df1c13, user_id=f29a499ee5764cf1b5af4ebac7cc8bbf, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.659211 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.683828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1214/2437] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:31 2022] PUT /identity/v3/projects/d54e9aa33042481c82e05f96b7df1c13/users/f29a499ee5764cf1b5af4ebac7cc8bbf/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:31.710084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1224/2438] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:31.721049 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.723036 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:31.755762 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61480008-7f1a-410b-b308-d7ba4550dc3e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.756209 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61480008-7f1a-410b-b308-d7ba4550dc3e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.757401 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61480008-7f1a-410b-b308-d7ba4550dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.806737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81119b-ff4d-41b8-b032-789b61409e5b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.811282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-61480008-7f1a-410b-b308-d7ba4550dc3e None None] MFA Rules not processed for user `f29a499ee5764cf1b5af4ebac7cc8bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:31.812288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.812872 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-61480008-7f1a-410b-b308-d7ba4550dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:31.813530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.814025 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.815259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.920700 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.922902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:31.939740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1225/2439] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:31.947112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61480008-7f1a-410b-b308-d7ba4550dc3e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:31.955281 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1215/2440] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:31.968279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61480008-7f1a-410b-b308-d7ba4550dc3e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:31.982856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:31.983709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:31.984037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:31.984357 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:31.985077 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:31.989111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:32.001351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:32.049520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1226/2441] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:31 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:32.052491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:32.065892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60464928-83bf-4e99-a358-216e652513d7 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:32.110628 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:32.163001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:32.163920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:32.164364 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:32.164868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:32.165834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:32.168172 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:32.218400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1216/2442] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:32 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:32.221766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:32.241291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07327c-5254-4be3-8666-112a8c80b79e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:32.247193 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:32.247810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:32.248088 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:32.248427 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:32.249086 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:32.250859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:32.289428 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1227/2443] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:32.296883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:32.313740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7be0-d89d-421e-ac86-418062aef7be admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:32.320870 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539afa6-16e3-4a67-a12d-df3cf3dc095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:32.321513 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539afa6-16e3-4a67-a12d-df3cf3dc095f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:32.321676 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539afa6-16e3-4a67-a12d-df3cf3dc095f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:32.321946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539afa6-16e3-4a67-a12d-df3cf3dc095f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:32.322608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539afa6-16e3-4a67-a12d-df3cf3dc095f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:32.324409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539afa6-16e3-4a67-a12d-df3cf3dc095f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:32.348876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1217/2444] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:32.349674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:32.361817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8416c2d-a203-49e6-9c63-296d26979130 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:32.368688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:32.369841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:32.370250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:32.371109 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] PATH_INFO: `/v3/projects/c8c85d9ba8ec4431880c37ecac75de39/users/e69ab5f0b1aa4b02b7f2c0bee0423b4f/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:32.401321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c85d9ba8ec4431880c37ecac75de39, user_id=e69ab5f0b1aa4b02b7f2c0bee0423b4f, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:32.416023 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:32.449284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1228/2445] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:32 2022] PUT /identity/v3/projects/c8c85d9ba8ec4431880c37ecac75de39/users/e69ab5f0b1aa4b02b7f2c0bee0423b4f/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:32.459497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4640-852f-4837-b345-b8312c086ae8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:32.459912 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4640-852f-4837-b345-b8312c086ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:32.460328 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4640-852f-4837-b345-b8312c086ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:32.509387 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-029a4640-852f-4837-b345-b8312c086ae8 None None] MFA Rules not processed for user `e69ab5f0b1aa4b02b7f2c0bee0423b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:32.510669 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-029a4640-852f-4837-b345-b8312c086ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:32.625226 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1218/2446] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:32.626671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:32.751488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f662-4f84-4f9e-a2e2-6b3a4c2e7662 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:32.756717 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:32.760671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:32.761104 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:32.761972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:32.763060 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:32.765135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:32.809280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1229/2447] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:32 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:32.810582 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a4640-852f-4837-b345-b8312c086ae8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:32.828340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a4640-852f-4837-b345-b8312c086ae8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:32.946180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:32.946815 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:32.947112 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:32.947404 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:32.948343 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:32.950902 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.010018 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1219/2448] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:32 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:33.011767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.037743 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd3e0b-ce62-4649-9b2d-56e0c3557ae5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.043240 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13548c3-1c62-43d1-b33e-dc52e0cb8097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.043922 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13548c3-1c62-43d1-b33e-dc52e0cb8097 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.044409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13548c3-1c62-43d1-b33e-dc52e0cb8097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.044769 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13548c3-1c62-43d1-b33e-dc52e0cb8097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.045436 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13548c3-1c62-43d1-b33e-dc52e0cb8097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.047068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13548c3-1c62-43d1-b33e-dc52e0cb8097 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.065422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1230/2449] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:33.070168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.089625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472692e-b3e7-4610-9a7c-82d98d1f554c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.099194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.099982 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.100332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.100736 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] PATH_INFO: `/v3/projects/f70ebb47f21540c2a546d1600ac18f7e/users/a49961dd781e4b939d029876ceecc936/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.122602 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70ebb47f21540c2a546d1600ac18f7e, user_id=a49961dd781e4b939d029876ceecc936, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.127470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.154126 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b49c-8540-4b19-be68-1a8c245048ae None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.154429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b49c-8540-4b19-be68-1a8c245048ae None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.154765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298b49c-8540-4b19-be68-1a8c245048ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.190315 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1220/2450] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:33 2022] PUT /identity/v3/projects/f70ebb47f21540c2a546d1600ac18f7e/users/a49961dd781e4b939d029876ceecc936/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:33.194677 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.208331 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:33.215669 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7298b49c-8540-4b19-be68-1a8c245048ae None None] MFA Rules not processed for user `7544fc1564d44db395df632467754e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:33.217437 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7298b49c-8540-4b19-be68-1a8c245048ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:33.362971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1231/2451] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:33.366897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d535cf8-efb6-4ef4-8ea4-05d07d733267 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.368435 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b49c-8540-4b19-be68-1a8c245048ae None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.374023 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.374791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.375183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.375531 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.376391 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.381932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.387824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298b49c-8540-4b19-be68-1a8c245048ae None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.418413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1221/2452] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:33.421637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.436210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952c06-42fd-4fcd-98c9-6b5ad5ce981b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.444310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.444890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.445250 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.445531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.446312 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.450107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.471455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:33.485061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43af3d5-ee66-4dc3-9b37-e73c905c314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.485061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af3d5-ee66-4dc3-9b37-e73c905c314f admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.485061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af3d5-ee66-4dc3-9b37-e73c905c314f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.485061 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af3d5-ee66-4dc3-9b37-e73c905c314f admin admin] PATH_INFO: `/v3/projects/f70ebb47f21540c2a546d1600ac18f7e/users/a49961dd781e4b939d029876ceecc936/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.488244 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43af3d5-ee66-4dc3-9b37-e73c905c314f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70ebb47f21540c2a546d1600ac18f7e, user_id=a49961dd781e4b939d029876ceecc936, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.493766 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43af3d5-ee66-4dc3-9b37-e73c905c314f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.511665 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1232/2453] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:33 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:33.515994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.525206 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1222/2454] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:33 2022] PUT /identity/v3/projects/f70ebb47f21540c2a546d1600ac18f7e/users/a49961dd781e4b939d029876ceecc936/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:33.537103 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.537409 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.537664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.596991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] MFA Rules not processed for user `a49961dd781e4b939d029876ceecc936`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:33.598774 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:33.637195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c304d-cc2d-4ebf-97ec-6b6743205dbe admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.774690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.775351 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.775766 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.775901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.776781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.779478 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.788166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1223/2455] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:33.802622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.806057 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:33.812790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1233/2456] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:33 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:33.816611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.833644 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a52a2-0d4a-4ec0-adab-b9fcf00773ff admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.841305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.842101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.842554 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.842977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.843946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.846217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.864090 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1234/2457] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:33.868056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:33.885511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314df59-5085-48ec-ad54-abeb29bb2092 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.897697 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.899761 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.900292 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.900963 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] PATH_INFO: `/v3/projects/2fd9354a3b234f3685e63e063ec395e7/users/6b42cc76d8994d2fb2eb6af93c94463f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.901161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793a83d-2b3f-44f5-944d-2405dc967812 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:33.911757 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:33.912395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:33.912670 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:33.912940 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:33.934001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd9354a3b234f3685e63e063ec395e7, user_id=6b42cc76d8994d2fb2eb6af93c94463f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:33.937741 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:33.960983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:33.967738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1235/2458] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:33 2022] PUT /identity/v3/projects/2fd9354a3b234f3685e63e063ec395e7/users/6b42cc76d8994d2fb2eb6af93c94463f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:33.991049 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:34.015794 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:34.017760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:34.052817 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1224/2459] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:34.129380 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:34.153699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f08498-6ed6-41e2-87ed-baa05c4a7f5a admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:34.162459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e72e-6fe4-4b51-8bf2-791d08ec8d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:34.163774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e72e-6fe4-4b51-8bf2-791d08ec8d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:34.164191 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e72e-6fe4-4b51-8bf2-791d08ec8d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:34.164598 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e72e-6fe4-4b51-8bf2-791d08ec8d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:34.165400 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206e72e-6fe4-4b51-8bf2-791d08ec8d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:34.167211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206e72e-6fe4-4b51-8bf2-791d08ec8d23 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:34.184229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1236/2460] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:34.188427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:34.205753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ac995-1dc7-43a2-88d8-8523eb0439ef service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:34.211960 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649b0ac-fc04-4cc1-a0be-9141b279458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:34.213144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649b0ac-fc04-4cc1-a0be-9141b279458e admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:34.213492 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649b0ac-fc04-4cc1-a0be-9141b279458e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:34.213855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649b0ac-fc04-4cc1-a0be-9141b279458e admin admin] PATH_INFO: `/v3/projects/2fd9354a3b234f3685e63e063ec395e7/users/6b42cc76d8994d2fb2eb6af93c94463f/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:34.217869 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649b0ac-fc04-4cc1-a0be-9141b279458e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd9354a3b234f3685e63e063ec395e7, user_id=6b42cc76d8994d2fb2eb6af93c94463f, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:34.221040 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649b0ac-fc04-4cc1-a0be-9141b279458e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:34.249536 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1225/2461] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:34 2022] PUT /identity/v3/projects/2fd9354a3b234f3685e63e063ec395e7/users/6b42cc76d8994d2fb2eb6af93c94463f/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:35.009330 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:35.009617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:35.009901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:35.050227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] MFA Rules not processed for user `6b42cc76d8994d2fb2eb6af93c94463f`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:35.051496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.137113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1237/2462] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:35.153647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:35.154118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:35.154508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:35.188003 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] MFA Rules not processed for user `7544fc1564d44db395df632467754e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:35.189413 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.319502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1226/2463] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:35.331161 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:35.332695 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.441703 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:35.443321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.454252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8426384-52ad-47db-802c-a7059d17a146 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:35.460698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1429d5-5b90-4830-8be2-574efcb4c4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:35.461590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1429d5-5b90-4830-8be2-574efcb4c4ad service nova] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:35.461876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1429d5-5b90-4830-8be2-574efcb4c4ad service nova] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:35.462150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1429d5-5b90-4830-8be2-574efcb4c4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:35.475323 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1429d5-5b90-4830-8be2-574efcb4c4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:35.477002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1429d5-5b90-4830-8be2-574efcb4c4ad service nova] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:35.487909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1238/2464] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:35.555747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2a6f7-41e2-446c-877a-4c221bace65c None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:35.576068 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:35.576731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:35.577109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:35.577396 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] PATH_INFO: `/v3/users/a15b5e98c4c843adb74b5c54c2fe8a8b` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:35.578570 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15b5e98c4c843adb74b5c54c2fe8a8b)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:35.580589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:35.660491 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15b5e98c4c843adb74b5c54c2fe8a8b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:35.661647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15b5e98c4c843adb74b5c54c2fe8a8b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:35.674514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15b5e98c4c843adb74b5c54c2fe8a8b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:35.679803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:35.706860 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15b5e98c4c843adb74b5c54c2fe8a8b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:35.743858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15b5e98c4c843adb74b5c54c2fe8a8b'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:35.755975 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1227/2465] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:35 2022] DELETE /identity/v3/users/a15b5e98c4c843adb74b5c54c2fe8a8b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:31:35.760374 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:35.760661 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:35.760995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:35.776514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:35.781134 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.787852 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:35.789038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.874481 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:35.876956 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a7d0b-558c-4315-a06c-ba627edba07d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:35.884333 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:35.885108 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:35.885497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:35.885921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:35.888392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.891212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1239/2466] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:35.903134 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:35.905360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:35.982101 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4939c-7005-43b3-8d5b-a007625f4edc None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:35.987305 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:35.988185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:35.988929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:35.989255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:36.004361 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:36.005689 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:36.018202 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:36.020775 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:36.025349 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1240/2467] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:31:36.035170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1228/2468] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:36.604011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:36.606332 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:36.622632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7931de-c567-4773-9eba-843b57233d1b service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:36.640214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:36.642145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:36.642589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:36.643906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] PATH_INFO: `/v3/projects/f57d6a10212246e89446d0e0b8b7dd0e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:36.645955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57d6a10212246e89446d0e0b8b7dd0e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:36.648960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:36.739017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57d6a10212246e89446d0e0b8b7dd0e', 'request_id': 'req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:36.752570 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57d6a10212246e89446d0e0b8b7dd0e', 'request_id': 'req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:36.759992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57d6a10212246e89446d0e0b8b7dd0e', 'request_id': 'req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:36.784354 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] The token cache is being invalidate because project f57d6a10212246e89446d0e0b8b7dd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:36.784619 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:36.785528 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:36.787863 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1241/2469] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:36 2022] DELETE /identity/v3/projects/f57d6a10212246e89446d0e0b8b7dd0e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:36.791801 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:36.810811 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c7b12-c647-445e-a96d-e0ffdb5a0f86 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:36.912175 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:36.913042 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:36.913425 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:36.913798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] PATH_INFO: `/v3/users/0adfc42b9d764ef38e63a2fba76ae8e3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:36.915048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adfc42b9d764ef38e63a2fba76ae8e3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:36.917169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:36.981976 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:36.996722 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adfc42b9d764ef38e63a2fba76ae8e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:36.998482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adfc42b9d764ef38e63a2fba76ae8e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.011991 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adfc42b9d764ef38e63a2fba76ae8e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.027671 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:37.028937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adfc42b9d764ef38e63a2fba76ae8e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.029275 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:37.056158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adfc42b9d764ef38e63a2fba76ae8e3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.069385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1229/2470] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:36 2022] DELETE /identity/v3/users/0adfc42b9d764ef38e63a2fba76ae8e3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:37.108830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bdd59-9ca5-46c7-88c4-51c034ad4036 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:37.161889 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:37.188341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adc5eb-380d-43fd-ab62-c4951975b507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:37.188494 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adc5eb-380d-43fd-ab62-c4951975b507 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:37.189178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adc5eb-380d-43fd-ab62-c4951975b507 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:37.189178 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adc5eb-380d-43fd-ab62-c4951975b507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:37.191413 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-d7adc5eb-380d-43fd-ab62-c4951975b507 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:37.279628 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adc5eb-380d-43fd-ab62-c4951975b507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:37.281479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adc5eb-380d-43fd-ab62-c4951975b507 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:37.295790 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1242/2471] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:37.592631 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:37.594329 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:37.689176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb9439-d2f1-4639-908e-7f0ab21d5cc5 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:37.695834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:37.696508 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:37.696791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:37.697058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] PATH_INFO: `/v3/projects/395c337969fd4b51b86ae94ba06aae35` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:37.698336 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395c337969fd4b51b86ae94ba06aae35)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:37.700411 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:37.762514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395c337969fd4b51b86ae94ba06aae35', 'request_id': 'req-d7798ea2-2a45-4310-a0f9-0295776814c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.771841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395c337969fd4b51b86ae94ba06aae35', 'request_id': 'req-d7798ea2-2a45-4310-a0f9-0295776814c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.811321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395c337969fd4b51b86ae94ba06aae35', 'request_id': 'req-d7798ea2-2a45-4310-a0f9-0295776814c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.833970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] The token cache is being invalidate because project 395c337969fd4b51b86ae94ba06aae35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:37.834270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.834931 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-d7798ea2-2a45-4310-a0f9-0295776814c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:37.836921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1230/2472] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:37 2022] DELETE /identity/v3/projects/395c337969fd4b51b86ae94ba06aae35 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:37.843100 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74caa1-290a-4dfd-886f-af40d8d3acc5 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:37.843600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74caa1-290a-4dfd-886f-af40d8d3acc5 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:37.843718 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74caa1-290a-4dfd-886f-af40d8d3acc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:37.866320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-fe74caa1-290a-4dfd-886f-af40d8d3acc5 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:37.868811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-fe74caa1-290a-4dfd-886f-af40d8d3acc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:37.978707 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1243/2473] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:38.049392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40faafd-d172-4be5-b5ee-3ead92272c5d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.049678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40faafd-d172-4be5-b5ee-3ead92272c5d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.049955 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40faafd-d172-4be5-b5ee-3ead92272c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.088266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-f40faafd-d172-4be5-b5ee-3ead92272c5d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:38.090051 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f40faafd-d172-4be5-b5ee-3ead92272c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:38.103632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1231/2474] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:38.107310 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74caa1-290a-4dfd-886f-af40d8d3acc5 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:38.124131 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74caa1-290a-4dfd-886f-af40d8d3acc5 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:38.130215 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:38.130829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.131484 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.132113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.133024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:38.133473 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:38.136056 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:38.157958 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1244/2475] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:38.159290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40faafd-d172-4be5-b5ee-3ead92272c5d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:38.185017 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40faafd-d172-4be5-b5ee-3ead92272c5d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:38.189835 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:38.190554 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.191016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.191494 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.192299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:38.201683 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:38.257527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1232/2476] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:38 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:38.261950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:38.279203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774a81f-addd-4526-bf9a-a375b538a86c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:38.405187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:38.405813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.406093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.406980 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.409306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:38.412221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:38.442800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1245/2477] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:38 2022] POST /identity/v3/users => generated 284 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:38.447712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:38.467158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6540-5286-4f0a-9781-7083b22b1eaf admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:38.474603 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:38.475383 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.475752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.476028 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.476687 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:38.479350 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:38.494141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1233/2478] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:31:38.498409 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:38.513779 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ecad8-7c2f-4435-89e2-86821033aa87 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:38.519556 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a943eac-bafa-4f05-837c-f3535d30c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:38.520174 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a943eac-bafa-4f05-837c-f3535d30c8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.520580 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a943eac-bafa-4f05-837c-f3535d30c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.520895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a943eac-bafa-4f05-837c-f3535d30c8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.521558 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a943eac-bafa-4f05-837c-f3535d30c8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:38.536588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a943eac-bafa-4f05-837c-f3535d30c8ec admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:38.548211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:38.559609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1246/2479] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:38.563607 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:38.570737 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:38.580062 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2055b4b-e75a-4302-87b4-5d3199a033e1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:38.607388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:38.608753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.611457 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.611970 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] PATH_INFO: `/v3/projects/36468da09fda457abe9101f9810ac3b8/users/8d4610a35dbe4eeba963c72ee2634dc8/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.646292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36468da09fda457abe9101f9810ac3b8, user_id=8d4610a35dbe4eeba963c72ee2634dc8, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:38.649145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:38.685086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1234/2480] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:38 2022] PUT /identity/v3/projects/36468da09fda457abe9101f9810ac3b8/users/8d4610a35dbe4eeba963c72ee2634dc8/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:38.695236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:38.695574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:38.695804 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:38.774622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] MFA Rules not processed for user `8d4610a35dbe4eeba963c72ee2634dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:38.778381 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:38.964169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1247/2481] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:38.982021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:38.985440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:39.091600 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea209c8-63e7-4545-9a3f-7cd1415dda96 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:39.096366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48727af9-d3a7-4417-b194-9101231699e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997c5e419c4045f4b8db4f6c1865d18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:39.097261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727af9-d3a7-4417-b194-9101231699e3 service glance] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:39.097901 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727af9-d3a7-4417-b194-9101231699e3 service glance] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:39.098459 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727af9-d3a7-4417-b194-9101231699e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:39.110884 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48727af9-d3a7-4417-b194-9101231699e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:39.112851 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48727af9-d3a7-4417-b194-9101231699e3 service glance] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:39.125321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1235/2482] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:41.724765 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:41.726338 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:41.811609 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc383ea-de84-4775-9a58-24400ec26f4b None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:41.817866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:41.818522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:41.818802 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:41.819099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] PATH_INFO: `/v3/users/f29a499ee5764cf1b5af4ebac7cc8bbf` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:41.820278 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29a499ee5764cf1b5af4ebac7cc8bbf)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:41.822200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:41.891587 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29a499ee5764cf1b5af4ebac7cc8bbf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:41.892306 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29a499ee5764cf1b5af4ebac7cc8bbf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:41.902755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29a499ee5764cf1b5af4ebac7cc8bbf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:41.925571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29a499ee5764cf1b5af4ebac7cc8bbf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:41.935576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29a499ee5764cf1b5af4ebac7cc8bbf'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:41.975792 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1248/2483] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:41 2022] DELETE /identity/v3/users/f29a499ee5764cf1b5af4ebac7cc8bbf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:41.981893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef79f91-dd15-4aab-9882-622ad79c15f4 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:41.981893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef79f91-dd15-4aab-9882-622ad79c15f4 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:41.981893 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef79f91-dd15-4aab-9882-622ad79c15f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:42.003825 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-cef79f91-dd15-4aab-9882-622ad79c15f4 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:42.006106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-cef79f91-dd15-4aab-9882-622ad79c15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:42.078839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1236/2484] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:42.088445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:42.089948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:42.104991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:42.176657 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bb7e4-084d-4a89-9db9-d56a268df0d9 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:42.185699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:42.186441 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:42.186727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:42.186998 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:42.205025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:42.206908 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:42.218097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1249/2485] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:42.376384 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed92d4-5937-4fb2-a05f-a316de76f2c1 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:42.376727 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed92d4-5937-4fb2-a05f-a316de76f2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:42.377008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed92d4-5937-4fb2-a05f-a316de76f2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:42.410422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-b7ed92d4-5937-4fb2-a05f-a316de76f2c1 None None] MFA Rules not processed for user `b320199614cf4d89b692badd01a97db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:42.411708 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b7ed92d4-5937-4fb2-a05f-a316de76f2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:42.490327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1237/2486] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:42.534576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:42.536531 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:42.552764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4382a46-0205-4b3e-8cd8-cbb9f7c02bbe service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:42.557641 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:42.558282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:42.558576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:42.558840 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] PATH_INFO: `/v3/projects/d54e9aa33042481c82e05f96b7df1c13` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:42.560020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54e9aa33042481c82e05f96b7df1c13)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:42.561917 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:42.612334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54e9aa33042481c82e05f96b7df1c13', 'request_id': 'req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.618923 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54e9aa33042481c82e05f96b7df1c13', 'request_id': 'req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.624783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54e9aa33042481c82e05f96b7df1c13', 'request_id': 'req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.644366 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] The token cache is being invalidate because project d54e9aa33042481c82e05f96b7df1c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:42.644783 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.645679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.647832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1250/2487] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:42 2022] DELETE /identity/v3/projects/d54e9aa33042481c82e05f96b7df1c13 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:42.652142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed92d4-5937-4fb2-a05f-a316de76f2c1 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:42.663344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed92d4-5937-4fb2-a05f-a316de76f2c1 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:42.693248 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:42.736549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:42.737102 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:42.737375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:42.737647 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] PATH_INFO: `/v3/users/e69ab5f0b1aa4b02b7f2c0bee0423b4f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:42.738784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69ab5f0b1aa4b02b7f2c0bee0423b4f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:42.740750 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:42.790389 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69ab5f0b1aa4b02b7f2c0bee0423b4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.791111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69ab5f0b1aa4b02b7f2c0bee0423b4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.798952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69ab5f0b1aa4b02b7f2c0bee0423b4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.807537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69ab5f0b1aa4b02b7f2c0bee0423b4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.820183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69ab5f0b1aa4b02b7f2c0bee0423b4f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:42.826936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1238/2488] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:42 2022] DELETE /identity/v3/users/e69ab5f0b1aa4b02b7f2c0bee0423b4f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:43.262151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:43.263860 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:43.293710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeb559-9b77-4ecd-b6c8-e1b188e050d7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:43.356706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:43.357348 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:43.357622 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:43.357898 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] PATH_INFO: `/v3/projects/c8c85d9ba8ec4431880c37ecac75de39` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:43.359042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c85d9ba8ec4431880c37ecac75de39)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:43.361044 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:43.401757 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:43.414284 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c85d9ba8ec4431880c37ecac75de39', 'request_id': 'req-70d0dba7-a378-489a-af73-69666572efda'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.420737 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c85d9ba8ec4431880c37ecac75de39', 'request_id': 'req-70d0dba7-a378-489a-af73-69666572efda'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.426742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c85d9ba8ec4431880c37ecac75de39', 'request_id': 'req-70d0dba7-a378-489a-af73-69666572efda'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.439786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] The token cache is being invalidate because project c8c85d9ba8ec4431880c37ecac75de39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:43.440072 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.440690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.442256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1251/2489] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:43 2022] DELETE /identity/v3/projects/c8c85d9ba8ec4431880c37ecac75de39 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:43.446509 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:43.447983 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:43.463555 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982d97-767b-49a3-8125-2deba4fe673b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:43.535123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:43.535833 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:43.536123 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:43.536421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] PATH_INFO: `/v3/users/a49961dd781e4b939d029876ceecc936` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:43.537637 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49961dd781e4b939d029876ceecc936)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:43.539752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:43.600249 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49961dd781e4b939d029876ceecc936'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.600965 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49961dd781e4b939d029876ceecc936'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.602365 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:43.611936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49961dd781e4b939d029876ceecc936'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.623632 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49961dd781e4b939d029876ceecc936'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.637224 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-864c7953-fa2a-4db0-beaf-713e748954f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49961dd781e4b939d029876ceecc936'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:43.645643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1239/2490] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:31:43 2022] DELETE /identity/v3/users/a49961dd781e4b939d029876ceecc936 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:43.955052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:43.958170 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:43.973977 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0dba7-a378-489a-af73-69666572efda admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.086999 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.088169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.088638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.090370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] PATH_INFO: `/v3/projects/f70ebb47f21540c2a546d1600ac18f7e` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.091959 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70ebb47f21540c2a546d1600ac18f7e)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.094140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.182460 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70ebb47f21540c2a546d1600ac18f7e', 'request_id': 'req-008dba64-1ec3-4025-bdd0-46c1d6919f37'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:44.190962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70ebb47f21540c2a546d1600ac18f7e', 'request_id': 'req-008dba64-1ec3-4025-bdd0-46c1d6919f37'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:44.196767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70ebb47f21540c2a546d1600ac18f7e', 'request_id': 'req-008dba64-1ec3-4025-bdd0-46c1d6919f37'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:44.210138 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] The token cache is being invalidate because project f70ebb47f21540c2a546d1600ac18f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:31:44.210425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:44.211039 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-008dba64-1ec3-4025-bdd0-46c1d6919f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:31:44.212540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1252/2491] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:31:43 2022] DELETE /identity/v3/projects/f70ebb47f21540c2a546d1600ac18f7e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:44.218612 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394fefb-59f1-41dc-a731-5048b96be0dd None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.218899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394fefb-59f1-41dc-a731-5048b96be0dd None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.219209 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394fefb-59f1-41dc-a731-5048b96be0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.240873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d394fefb-59f1-41dc-a731-5048b96be0dd None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:44.243136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d394fefb-59f1-41dc-a731-5048b96be0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:44.305141 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1240/2492] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:44.312945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085251-a45e-4740-80fe-9c8c94adc38e None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.313476 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085251-a45e-4740-80fe-9c8c94adc38e None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.313605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085251-a45e-4740-80fe-9c8c94adc38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.334638 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-30085251-a45e-4740-80fe-9c8c94adc38e None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:44.335890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-30085251-a45e-4740-80fe-9c8c94adc38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:44.345029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1253/2493] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:44.349239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394fefb-59f1-41dc-a731-5048b96be0dd None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.361176 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394fefb-59f1-41dc-a731-5048b96be0dd None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.366377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.367289 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.367614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.367949 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.368936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:31:44.368936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.370566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.387779 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1241/2494] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:31:44.389145 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085251-a45e-4740-80fe-9c8c94adc38e None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.398698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085251-a45e-4740-80fe-9c8c94adc38e None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.404195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.404812 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.405118 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.405422 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.406050 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.409125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.457414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1254/2495] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:31:44 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:31:44.458873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.469858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f9800-60e0-4a92-9574-1222df60306b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.531455 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.532821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.532821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.532821 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.533341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.535313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.558480 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1242/2496] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:31:44 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:31:44.563295 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.576406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85c336-6122-448f-befc-b04a82b27b91 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.582073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.583500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.584192 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.584724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.587486 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.590197 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.607135 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1255/2497] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:44.609534 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.622437 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f70b3-5fa3-4671-9692-654f7bbe0b7c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.627571 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facb25-873a-4b5f-9ce8-28cb234df76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.628183 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facb25-873a-4b5f-9ce8-28cb234df76e admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.628915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facb25-873a-4b5f-9ce8-28cb234df76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.628915 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facb25-873a-4b5f-9ce8-28cb234df76e admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.629375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31facb25-873a-4b5f-9ce8-28cb234df76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.631035 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31facb25-873a-4b5f-9ce8-28cb234df76e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.643128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1243/2498] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:31:44.647699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.658751 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1650c-df9a-46c9-987c-8c45edcb5b2e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.664219 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.664873 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.665155 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.665432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] PATH_INFO: `/v3/projects/9a0a633dad214baab9de5ee38e099788/users/b398cb5b55cb46da975580b006b2816f/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.678575 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:44.685188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0a633dad214baab9de5ee38e099788, user_id=b398cb5b55cb46da975580b006b2816f, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.686966 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.702764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1256/2499] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:31:44 2022] PUT /identity/v3/projects/9a0a633dad214baab9de5ee38e099788/users/b398cb5b55cb46da975580b006b2816f/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:31:44.714170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca43d6-330a-454d-9f97-5fa097f430fa None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.714464 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca43d6-330a-454d-9f97-5fa097f430fa None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.714729 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca43d6-330a-454d-9f97-5fa097f430fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.743145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-70ca43d6-330a-454d-9f97-5fa097f430fa None None] MFA Rules not processed for user `b398cb5b55cb46da975580b006b2816f`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:44.744388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-70ca43d6-330a-454d-9f97-5fa097f430fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:44.765327 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:44.825957 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1244/2500] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:31:44.838605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.840492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:44.862952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630708-9159-4441-8746-4c10bc72c932 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.862952 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630708-9159-4441-8746-4c10bc72c932 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.863257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630708-9159-4441-8746-4c10bc72c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.890451 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-eb630708-9159-4441-8746-4c10bc72c932 None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:31:44.892335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-eb630708-9159-4441-8746-4c10bc72c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:44.910687 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5f7a-8559-4cf6-969a-d41b5a535dbb admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:44.914940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:44.915720 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:44.916291 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:44.916809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:44.939854 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:44.941304 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:44.952002 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1257/2501] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:44.962245 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1245/2502] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Oct 19 13:31:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:31:44.981133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:44.982948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:45.071202 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8e46-881e-4e73-adc3-f05e31a99d07 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:45.076603 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:45.077381 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:45.077678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:45.077951 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:45.087780 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:45.089560 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:45.107807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1258/2503] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:31:54.954778 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=43 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:55.101704 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:59.191125 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630708-9159-4441-8746-4c10bc72c932 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:59.201097 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630708-9159-4441-8746-4c10bc72c932 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:59.205037 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:59.205641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:59.206048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:59.206388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:59.208466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:59.280316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:59.282371 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:59.292994 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1246/2504] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:59.711368 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:59.712895 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:59.796510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7241c-7edc-439e-b2c5-0cd487ef6a31 service swift] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:59.806831 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:59.808320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:59.808807 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:59.809450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:59.812007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:31:59.825764 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:31:59.827809 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:31:59.840568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1259/2505] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:31:59.921266 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:31:59.936398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84077f4-21f4-4ec1-885e-f4bfcfca2540 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:31:59.944098 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25c9e-104e-4f18-913b-111af9907a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:31:59.944847 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25c9e-104e-4f18-913b-111af9907a61 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:31:59.945136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25c9e-104e-4f18-913b-111af9907a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:31:59.945447 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25c9e-104e-4f18-913b-111af9907a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:31:59.948448 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-ccf25c9e-104e-4f18-913b-111af9907a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:00.050803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf25c9e-104e-4f18-913b-111af9907a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:00.052321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf25c9e-104e-4f18-913b-111af9907a61 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:00.069358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1247/2506] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:31:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:32:04.769607 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:04.771112 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:04.939881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9370cd8-9f6d-4f4a-9d94-163ab3363db5 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:04.950149 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:04.951913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:04.952395 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:04.952837 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] PATH_INFO: `/v3/users/8d4610a35dbe4eeba963c72ee2634dc8` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:04.955052 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4610a35dbe4eeba963c72ee2634dc8)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:04.957025 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:05.017450 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:05.020714 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4610a35dbe4eeba963c72ee2634dc8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.021891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4610a35dbe4eeba963c72ee2634dc8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.031811 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4610a35dbe4eeba963c72ee2634dc8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.045207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4610a35dbe4eeba963c72ee2634dc8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.045927 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4610a35dbe4eeba963c72ee2634dc8'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.060252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1260/2507] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:04 2022] DELETE /identity/v3/users/8d4610a35dbe4eeba963c72ee2634dc8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:05.065658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:05.066291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:05.066291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:05.116819 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:05.118071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:05.207305 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1248/2508] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:05.225555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:05.226981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:05.330290 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd13a-fdea-43ca-ae56-617067e1b1d8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:05.334156 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3c95-9daf-44f7-abd2-2b7a3eb46bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:05.334926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3c95-9daf-44f7-abd2-2b7a3eb46bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:05.335372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3c95-9daf-44f7-abd2-2b7a3eb46bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:05.335755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3c95-9daf-44f7-abd2-2b7a3eb46bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:05.347255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3c95-9daf-44f7-abd2-2b7a3eb46bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:05.348824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3c95-9daf-44f7-abd2-2b7a3eb46bb6 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:05.360233 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1261/2509] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:05.662152 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:05.663706 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:05.678283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5a6a1-7d0d-409c-9ab3-5fb20aa489f7 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:05.689086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:05.689086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:05.693584 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:05.694109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] PATH_INFO: `/v3/projects/36468da09fda457abe9101f9810ac3b8` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:05.696008 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36468da09fda457abe9101f9810ac3b8)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:05.699836 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:05.714724 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=100 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:05.778876 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36468da09fda457abe9101f9810ac3b8', 'request_id': 'req-09cda11c-3394-4965-84b5-1a2d18553367'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.802832 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36468da09fda457abe9101f9810ac3b8', 'request_id': 'req-09cda11c-3394-4965-84b5-1a2d18553367'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.807169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36468da09fda457abe9101f9810ac3b8', 'request_id': 'req-09cda11c-3394-4965-84b5-1a2d18553367'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.825712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] The token cache is being invalidate because project 36468da09fda457abe9101f9810ac3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:05.826088 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.826827 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-09cda11c-3394-4965-84b5-1a2d18553367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:05.828731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1249/2510] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:05 2022] DELETE /identity/v3/projects/36468da09fda457abe9101f9810ac3b8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:05.833430 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b91b85-51fb-4036-8e8b-bae091c0fd35 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:05.833901 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b91b85-51fb-4036-8e8b-bae091c0fd35 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:05.834083 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b91b85-51fb-4036-8e8b-bae091c0fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:05.896539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c6b91b85-51fb-4036-8e8b-bae091c0fd35 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:05.897888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c6b91b85-51fb-4036-8e8b-bae091c0fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:05.962008 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1262/2511] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:32:05.971624 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb15e6-102e-4c5b-aabc-0fa9249fc805 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:05.972013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb15e6-102e-4c5b-aabc-0fa9249fc805 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:05.972393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb15e6-102e-4c5b-aabc-0fa9249fc805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:05.994497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-03bb15e6-102e-4c5b-aabc-0fa9249fc805 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:05.996097 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-03bb15e6-102e-4c5b-aabc-0fa9249fc805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:06.005402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1250/2512] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:32:06.009944 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b91b85-51fb-4036-8e8b-bae091c0fd35 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:06.020994 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b91b85-51fb-4036-8e8b-bae091c0fd35 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:06.026402 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:06.027037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.027333 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.027615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.028274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:32:06.028586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:06.030188 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:06.045859 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1263/2513] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 19 13:32:06.050400 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb15e6-102e-4c5b-aabc-0fa9249fc805 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:06.060106 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb15e6-102e-4c5b-aabc-0fa9249fc805 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:06.065004 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:06.065618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.065900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.066443 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.066809 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:06.068760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:06.103186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1251/2514] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:32:06 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:06.104855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:06.115177 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854770bc-b4c3-4fd7-b07c-70f68411f360 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:06.123048 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:06.177059 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:06.177674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.177957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.178232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.178875 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:06.180834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:06.202317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1264/2515] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:32:06 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:06.206771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:06.217758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647121a4-485f-45e5-a49b-ac0ca46f62d8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:06.222452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:06.223047 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.223360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.223636 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.224283 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:06.225885 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:06.235770 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1252/2516] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:06.239582 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:06.249973 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8e3d7-0e23-4cbe-a44c-2e057079f099 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:06.254726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f62825-e36b-4175-b498-b5c43bdcb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:06.255418 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62825-e36b-4175-b498-b5c43bdcb271 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.255706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62825-e36b-4175-b498-b5c43bdcb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.255981 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62825-e36b-4175-b498-b5c43bdcb271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.256632 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f62825-e36b-4175-b498-b5c43bdcb271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:06.258267 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f62825-e36b-4175-b498-b5c43bdcb271 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:06.269200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1265/2517] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:06.273377 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:06.283972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1e24b-1616-42af-8deb-cd0cac2622ad admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:06.288695 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:06.289345 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.289630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.289909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] PATH_INFO: `/v3/projects/9f09ba65af174d0f8ee11573f003d509/users/7d38e3607acd4369b817110fe9b6ed1e/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.308180 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f09ba65af174d0f8ee11573f003d509, user_id=7d38e3607acd4369b817110fe9b6ed1e, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:06.312744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:06.327298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1253/2518] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:06 2022] PUT /identity/v3/projects/9f09ba65af174d0f8ee11573f003d509/users/7d38e3607acd4369b817110fe9b6ed1e/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:06.337325 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.337611 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.337916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.368144 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] MFA Rules not processed for user `7d38e3607acd4369b817110fe9b6ed1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:06.369945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:06.441273 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1266/2519] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:06.453257 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:06.457947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:06.521269 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671134d6-a0b2-4905-bd8d-76930f041965 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:06.525195 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:06.526190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:06.526502 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:06.526780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:06.536574 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:06.538136 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:06.548149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1254/2520] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:10.015800 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:10.024493 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:10.084709 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696841ed-0f36-4aa5-ad16-0a098ce173d1 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:10.089280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef24db-a215-42a3-922b-a0bf5d47132b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:10.090033 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef24db-a215-42a3-922b-a0bf5d47132b service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:10.090453 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef24db-a215-42a3-922b-a0bf5d47132b service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:10.090945 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef24db-a215-42a3-922b-a0bf5d47132b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:10.092738 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-42ef24db-a215-42a3-922b-a0bf5d47132b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:10.133007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:10.165918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef24db-a215-42a3-922b-a0bf5d47132b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:10.167415 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef24db-a215-42a3-922b-a0bf5d47132b service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:10.177540 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1267/2521] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:16.543744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:17.112203 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:17.184470 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5a4da-d360-4735-b34e-6b6ddf22a275 service cinder] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:17.190577 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:17.191150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:17.191440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:17.191717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] PATH_INFO: `/v3/users/7d38e3607acd4369b817110fe9b6ed1e` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:17.192879 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d38e3607acd4369b817110fe9b6ed1e)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:17.194842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:17.249321 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d38e3607acd4369b817110fe9b6ed1e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.250071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d38e3607acd4369b817110fe9b6ed1e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.257842 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d38e3607acd4369b817110fe9b6ed1e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.266859 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d38e3607acd4369b817110fe9b6ed1e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.281071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d38e3607acd4369b817110fe9b6ed1e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.287466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1255/2522] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:17 2022] DELETE /identity/v3/users/7d38e3607acd4369b817110fe9b6ed1e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:17.292675 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:17.293147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:17.293247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:17.320321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:17.321682 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:17.399984 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1268/2523] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:17.407614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:17.409181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:17.474772 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551ad9-d64c-4c0d-ac7f-d42d7ee14cc8 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:17.479032 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:17.479813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:17.480146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:17.480393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:17.490883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:17.492839 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:17.503702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1256/2524] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:17.784410 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:17.786116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:17.799706 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c09ca2-12f0-4ae0-a17a-ce8eb6b3c75d None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:17.804543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:17.805322 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:17.805891 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:17.806020 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] PATH_INFO: `/v3/projects/9f09ba65af174d0f8ee11573f003d509` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:17.808236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f09ba65af174d0f8ee11573f003d509)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:17.810656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:17.862770 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f09ba65af174d0f8ee11573f003d509', 'request_id': 'req-c1497d41-0f62-466a-9821-856e755d4dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.869921 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f09ba65af174d0f8ee11573f003d509', 'request_id': 'req-c1497d41-0f62-466a-9821-856e755d4dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.876227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f09ba65af174d0f8ee11573f003d509', 'request_id': 'req-c1497d41-0f62-466a-9821-856e755d4dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.888612 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] The token cache is being invalidate because project 9f09ba65af174d0f8ee11573f003d509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:17.888907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.889584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-c1497d41-0f62-466a-9821-856e755d4dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:17.891282 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1269/2525] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:17 2022] DELETE /identity/v3/projects/9f09ba65af174d0f8ee11573f003d509 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:19.583398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:19.584889 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:19.598201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f902a-1227-4445-8b5d-a352ad8495b8 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:19.616420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:19.655392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:19.656021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:19.656310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:19.656566 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] PATH_INFO: `/v3/users/b398cb5b55cb46da975580b006b2816f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:19.657682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b398cb5b55cb46da975580b006b2816f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:19.659644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:19.706109 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b398cb5b55cb46da975580b006b2816f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:19.706749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b398cb5b55cb46da975580b006b2816f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:19.713749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b398cb5b55cb46da975580b006b2816f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:19.720438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b398cb5b55cb46da975580b006b2816f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:19.733278 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b398cb5b55cb46da975580b006b2816f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:19.739067 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1257/2526] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:19 2022] DELETE /identity/v3/users/b398cb5b55cb46da975580b006b2816f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:19.743555 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:19.744080 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:19.744181 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:19.763509 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:19.764723 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:19.810830 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:19.825133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1270/2527] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:19.834753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:19.836210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:19.892702 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe262e-4bd3-4bfc-a9c3-b7190a884713 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:19.896395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32632d15-9a22-4e6c-8c61-3bc703d0461f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:19.896998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32632d15-9a22-4e6c-8c61-3bc703d0461f service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:19.897278 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32632d15-9a22-4e6c-8c61-3bc703d0461f service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:19.897551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32632d15-9a22-4e6c-8c61-3bc703d0461f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:19.907010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32632d15-9a22-4e6c-8c61-3bc703d0461f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:19.908466 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32632d15-9a22-4e6c-8c61-3bc703d0461f service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:19.917765 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1258/2528] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:20.187884 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.189369 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:20.203545 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0724-9114-430e-8b71-e48b9bc44b08 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.208399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.209140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.209585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.209961 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] PATH_INFO: `/v3/projects/9a0a633dad214baab9de5ee38e099788` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.211257 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0a633dad214baab9de5ee38e099788)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.213650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.262729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0a633dad214baab9de5ee38e099788', 'request_id': 'req-a493ccbb-5ae8-4587-8f72-23af40d2fd78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:20.268955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0a633dad214baab9de5ee38e099788', 'request_id': 'req-a493ccbb-5ae8-4587-8f72-23af40d2fd78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:20.274668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0a633dad214baab9de5ee38e099788', 'request_id': 'req-a493ccbb-5ae8-4587-8f72-23af40d2fd78'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:20.289819 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] The token cache is being invalidate because project 9a0a633dad214baab9de5ee38e099788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:20.290107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:20.290740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-a493ccbb-5ae8-4587-8f72-23af40d2fd78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:20.292287 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1271/2529] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:20 2022] DELETE /identity/v3/projects/9a0a633dad214baab9de5ee38e099788 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:20.298189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7120-797e-4c50-9260-b8162873af8a None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.298481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7120-797e-4c50-9260-b8162873af8a None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.298789 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7120-797e-4c50-9260-b8162873af8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.319225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-71bd7120-797e-4c50-9260-b8162873af8a None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:20.320681 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-71bd7120-797e-4c50-9260-b8162873af8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:20.364149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:20.386198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1259/2530] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:32:20.393856 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae475d-0baf-4b58-85eb-c98fc9f533c8 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.394147 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae475d-0baf-4b58-85eb-c98fc9f533c8 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.394429 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae475d-0baf-4b58-85eb-c98fc9f533c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.413782 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-00ae475d-0baf-4b58-85eb-c98fc9f533c8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:20.414983 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-00ae475d-0baf-4b58-85eb-c98fc9f533c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:20.423781 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1272/2531] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:20.427843 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7120-797e-4c50-9260-b8162873af8a None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.438586 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7120-797e-4c50-9260-b8162873af8a None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.443366 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.443978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.444273 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.444537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.445186 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:32:20.445489 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.447144 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.459976 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1260/2532] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:32:20.464217 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae475d-0baf-4b58-85eb-c98fc9f533c8 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.474456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae475d-0baf-4b58-85eb-c98fc9f533c8 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.479229 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.479829 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.480103 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.480404 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.481063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.482971 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.517567 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1273/2533] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:32:20 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:32:20.518786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.530510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18491a5f-04db-49a3-8572-69481c72558f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.594392 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.595056 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.599460 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.600270 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.600948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.603288 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.627900 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1261/2534] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:32:20 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:20.632151 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.643035 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd872cf-0763-4112-832f-7cf419c320ee admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.648328 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.648936 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.649216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.649489 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.650159 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.651805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.665462 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1274/2535] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:20.666643 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.676873 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef9444-b4e0-4513-b289-37168752129d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.681557 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c79f2-7c20-431e-8785-4508c1667d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.682161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c79f2-7c20-431e-8785-4508c1667d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.682452 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c79f2-7c20-431e-8785-4508c1667d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.682726 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c79f2-7c20-431e-8785-4508c1667d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.683410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c79f2-7c20-431e-8785-4508c1667d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.685551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c79f2-7c20-431e-8785-4508c1667d7f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.696488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1262/2536] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:20.701406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.711600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29a99-d26e-40c1-95a8-a87e823126d3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.716593 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.717248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.717518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.717793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] PATH_INFO: `/v3/projects/09000d396f3645e1b9e52e323a8811e5/users/cc1f7b8bb1504e7dbefea44eab2e8be0/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.733265 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09000d396f3645e1b9e52e323a8811e5, user_id=cc1f7b8bb1504e7dbefea44eab2e8be0, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.735913 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.749881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1275/2537] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:20 2022] PUT /identity/v3/projects/09000d396f3645e1b9e52e323a8811e5/users/cc1f7b8bb1504e7dbefea44eab2e8be0/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:20.761398 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.761698 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.762483 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.792395 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] MFA Rules not processed for user `cc1f7b8bb1504e7dbefea44eab2e8be0`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:20.793653 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:20.861011 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1263/2538] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:20.872317 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:20.874124 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:20.932511 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2c12-eab2-4a7c-9dd9-f06d7525dc2d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:20.936755 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:20.937372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:20.937656 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:20.937933 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:20.946535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:20.948084 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:20.957565 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1276/2539] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:21.117160 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:21.119405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:21.167576 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:21.198844 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e329-50b0-4949-874e-7e021f5cf653 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:21.203644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:21.204298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:21.204587 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:21.204852 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] PATH_INFO: `/v3/users/7544fc1564d44db395df632467754e53` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:21.206031 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7544fc1564d44db395df632467754e53)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:21.208105 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:21.278769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7544fc1564d44db395df632467754e53'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.279527 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7544fc1564d44db395df632467754e53'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.289428 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7544fc1564d44db395df632467754e53'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.298311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7544fc1564d44db395df632467754e53'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.312718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7544fc1564d44db395df632467754e53'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.322565 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1264/2540] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:21 2022] DELETE /identity/v3/users/7544fc1564d44db395df632467754e53 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:21.502288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:21.515432 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50248529-8c29-4d21-8475-afc97049d941 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:21.528756 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:21.576808 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:21.577557 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:21.577845 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:21.578127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] PATH_INFO: `/v3/projects/fca11851ea4743408e05b3a95a3e9b17` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:21.579320 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca11851ea4743408e05b3a95a3e9b17)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:21.581362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:21.628026 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca11851ea4743408e05b3a95a3e9b17', 'request_id': 'req-5271aa56-736c-4a47-ae3f-05fdb3117df5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.634551 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca11851ea4743408e05b3a95a3e9b17', 'request_id': 'req-5271aa56-736c-4a47-ae3f-05fdb3117df5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.640825 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca11851ea4743408e05b3a95a3e9b17', 'request_id': 'req-5271aa56-736c-4a47-ae3f-05fdb3117df5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.652694 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] The token cache is being invalidate because project fca11851ea4743408e05b3a95a3e9b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:21.652986 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.653620 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.655120 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1277/2541] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:21 2022] DELETE /identity/v3/projects/fca11851ea4743408e05b3a95a3e9b17 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:21.659370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:21.660798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:21.674592 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587d4d1-4261-47fa-9abd-b046e5a27e07 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:21.731382 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:21.732006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:21.732290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:21.732559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] PATH_INFO: `/v3/users/6b42cc76d8994d2fb2eb6af93c94463f` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:21.733707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b42cc76d8994d2fb2eb6af93c94463f)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:21.735818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:21.781823 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b42cc76d8994d2fb2eb6af93c94463f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.782401 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b42cc76d8994d2fb2eb6af93c94463f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.789196 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b42cc76d8994d2fb2eb6af93c94463f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.792718 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:21.797184 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b42cc76d8994d2fb2eb6af93c94463f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.810871 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-876200de-0ff3-4294-8563-13813203b2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b42cc76d8994d2fb2eb6af93c94463f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:21.816549 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1265/2542] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:21 2022] DELETE /identity/v3/users/6b42cc76d8994d2fb2eb6af93c94463f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:21.986597 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:21.988251 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:22.005608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271aa56-736c-4a47-ae3f-05fdb3117df5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.064618 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.065169 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.065454 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.065732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] PATH_INFO: `/v3/projects/2fd9354a3b234f3685e63e063ec395e7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.066886 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd9354a3b234f3685e63e063ec395e7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.068939 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.114105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:22.115820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd9354a3b234f3685e63e063ec395e7', 'request_id': 'req-2f34bef5-6782-40c8-96d7-8169ccb13389'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:22.123821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd9354a3b234f3685e63e063ec395e7', 'request_id': 'req-2f34bef5-6782-40c8-96d7-8169ccb13389'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:22.129501 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd9354a3b234f3685e63e063ec395e7', 'request_id': 'req-2f34bef5-6782-40c8-96d7-8169ccb13389'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:22.141586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] The token cache is being invalidate because project 2fd9354a3b234f3685e63e063ec395e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:22.141876 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:22.142492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-2f34bef5-6782-40c8-96d7-8169ccb13389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:22.144015 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1278/2543] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:21 2022] DELETE /identity/v3/projects/2fd9354a3b234f3685e63e063ec395e7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:22.149806 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb668-f78c-4b2e-9b76-eeefdbb230a9 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.150096 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb668-f78c-4b2e-9b76-eeefdbb230a9 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.150375 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb668-f78c-4b2e-9b76-eeefdbb230a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.171001 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-817cb668-f78c-4b2e-9b76-eeefdbb230a9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:22.172828 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-817cb668-f78c-4b2e-9b76-eeefdbb230a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:22.232948 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1266/2544] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:22.240686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbef63-d85e-41be-b077-4f7dd5995e69 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.240972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbef63-d85e-41be-b077-4f7dd5995e69 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.241247 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbef63-d85e-41be-b077-4f7dd5995e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.261216 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-71fbef63-d85e-41be-b077-4f7dd5995e69 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:22.263042 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-71fbef63-d85e-41be-b077-4f7dd5995e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:22.270726 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1279/2545] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:22.274887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cb668-f78c-4b2e-9b76-eeefdbb230a9 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:22.286145 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cb668-f78c-4b2e-9b76-eeefdbb230a9 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.290168 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.290730 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.291010 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.291311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.292050 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:32:22.292441 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.294013 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.310242 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1267/2546] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:32:22.311725 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbef63-d85e-41be-b077-4f7dd5995e69 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:22.321157 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbef63-d85e-41be-b077-4f7dd5995e69 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.326877 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.327439 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.327793 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.328071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.328727 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.330649 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.359662 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1280/2547] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:32:22 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:22.364223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:22.375556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207670f-8b70-443e-9bb9-4295f8651f4c admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.436707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.437332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.437619 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.437898 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.438537 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.440510 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.462167 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1268/2548] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:32:22 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:32:22.466836 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:22.477187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce366c-79dd-4613-91ce-d805b19bc1a3 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.482116 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.482744 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.483038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.483359 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.484123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.485667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.504512 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1281/2549] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:22.504613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:22.512340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83003a69-03ca-40aa-9298-0c1c33d99fcd admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.520122 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36617bc8-e1e9-43f8-8289-0014baba4e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.520946 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36617bc8-e1e9-43f8-8289-0014baba4e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.521294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36617bc8-e1e9-43f8-8289-0014baba4e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.521560 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36617bc8-e1e9-43f8-8289-0014baba4e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.522191 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36617bc8-e1e9-43f8-8289-0014baba4e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.523881 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36617bc8-e1e9-43f8-8289-0014baba4e39 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.537311 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1269/2550] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:22.541500 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:22.552821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6b648-be6a-4a57-a9df-55c734c7532d admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.559288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.559943 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.560223 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.560496 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] PATH_INFO: `/v3/projects/1421663921e449938fddfed8afd820b9/users/8e31e6abb68b41c28cce94337461817c/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.576664 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1421663921e449938fddfed8afd820b9, user_id=8e31e6abb68b41c28cce94337461817c, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.579334 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.593992 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1282/2551] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:22 2022] PUT /identity/v3/projects/1421663921e449938fddfed8afd820b9/users/8e31e6abb68b41c28cce94337461817c/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:22.604372 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733a30-38d4-49ea-b797-8ef905e09061 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.604658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733a30-38d4-49ea-b797-8ef905e09061 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.604930 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733a30-38d4-49ea-b797-8ef905e09061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.633243 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-15733a30-38d4-49ea-b797-8ef905e09061 None None] MFA Rules not processed for user `8e31e6abb68b41c28cce94337461817c`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:22.634588 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-15733a30-38d4-49ea-b797-8ef905e09061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:22.671655 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:22.706302 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1270/2552] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:22.718017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:22.719752 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:22.776701 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db778961-6910-418b-87dc-8f0b7d0b4776 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:22.780910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a17ed-9464-4827-adf4-fef67792782b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:22.781518 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a17ed-9464-4827-adf4-fef67792782b service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:22.781786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a17ed-9464-4827-adf4-fef67792782b service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:22.782053 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a17ed-9464-4827-adf4-fef67792782b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:22.790258 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a17ed-9464-4827-adf4-fef67792782b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:22.791719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a17ed-9464-4827-adf4-fef67792782b service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:22.800674 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1283/2553] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:28.118299 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15733a30-38d4-49ea-b797-8ef905e09061 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:28.181958 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15733a30-38d4-49ea-b797-8ef905e09061 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:28.186633 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:28.187297 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:28.187645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:28.187924 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] PATH_INFO: `/v3/users/8e31e6abb68b41c28cce94337461817c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:28.189078 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e31e6abb68b41c28cce94337461817c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:28.191073 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:28.237082 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e31e6abb68b41c28cce94337461817c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.237731 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e31e6abb68b41c28cce94337461817c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.244829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e31e6abb68b41c28cce94337461817c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.252608 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e31e6abb68b41c28cce94337461817c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.264664 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e31e6abb68b41c28cce94337461817c'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.270477 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1271/2554] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:28 2022] DELETE /identity/v3/users/8e31e6abb68b41c28cce94337461817c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:28.274929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:28.275445 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:28.275606 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:28.295095 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:28.296553 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:28.354505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1284/2555] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:28.364798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:28.366179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:28.424026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:28.446159 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22944e4-c851-413e-af10-63e46901619d admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:28.450422 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068f5b-bd73-43fc-a824-709da852b651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:28.451045 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068f5b-bd73-43fc-a824-709da852b651 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:28.451349 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068f5b-bd73-43fc-a824-709da852b651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:28.451622 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068f5b-bd73-43fc-a824-709da852b651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:28.460615 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068f5b-bd73-43fc-a824-709da852b651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:28.462058 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068f5b-bd73-43fc-a824-709da852b651 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:28.472129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1272/2556] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:28.733148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:28.734702 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:28.747231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3c79a-52b0-4051-bb2e-3b12568ddca9 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:28.751906 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:28.752544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:28.752820 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:28.753089 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] PATH_INFO: `/v3/projects/1421663921e449938fddfed8afd820b9` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:28.754206 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1421663921e449938fddfed8afd820b9)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:28.756239 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:28.767544 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:28.805021 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1421663921e449938fddfed8afd820b9', 'request_id': 'req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.811885 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1421663921e449938fddfed8afd820b9', 'request_id': 'req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.820777 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1421663921e449938fddfed8afd820b9', 'request_id': 'req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.835610 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] The token cache is being invalidate because project 1421663921e449938fddfed8afd820b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:28.835907 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.836538 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-d5c7ea14-6bf1-42cc-b7ba-bfd34b9dc975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:28.838399 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1285/2557] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:28 2022] DELETE /identity/v3/projects/1421663921e449938fddfed8afd820b9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:28.843173 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076953e-470b-400d-a1b6-8d2f63de83ef None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:28.843460 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076953e-470b-400d-a1b6-8d2f63de83ef None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:28.843733 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076953e-470b-400d-a1b6-8d2f63de83ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:28.864793 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-d076953e-470b-400d-a1b6-8d2f63de83ef None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:28.866194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-d076953e-470b-400d-a1b6-8d2f63de83ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:28.926414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1273/2558] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:28.935729 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b02d2c-a101-411f-9fbb-d38c100b2337 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:28.936079 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b02d2c-a101-411f-9fbb-d38c100b2337 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:28.936364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b02d2c-a101-411f-9fbb-d38c100b2337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:28.956749 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-33b02d2c-a101-411f-9fbb-d38c100b2337 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:28.957964 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-33b02d2c-a101-411f-9fbb-d38c100b2337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:28.966016 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1286/2559] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:28.970385 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076953e-470b-400d-a1b6-8d2f63de83ef None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:28.980764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076953e-470b-400d-a1b6-8d2f63de83ef None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:28.985648 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:28.986239 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:28.986514 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:28.986867 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:28.987593 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:32:28.987897 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:28.990223 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.003883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1274/2560] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:32:29.008204 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b02d2c-a101-411f-9fbb-d38c100b2337 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.018667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b02d2c-a101-411f-9fbb-d38c100b2337 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.023431 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.024036 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.024319 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.024596 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.025243 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.027172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.054690 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1287/2561] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:32:29 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:29.059495 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.070644 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f62aa-ed78-4500-9cef-13ddbe7253b1 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.126071 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.126682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.126872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.127179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.127841 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.129805 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.151678 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1275/2562] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:32:29 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:29.155815 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.166073 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7e4f-73ab-4621-8c30-8682619c30c1 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.171425 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.172029 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.172309 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.172586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.173234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.174866 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.187742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1288/2563] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:29.191717 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.201882 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0b497-80a8-458a-bf00-fbc6fc421b56 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.206979 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176414a-b811-4c2f-95f6-7462e95badd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.207617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176414a-b811-4c2f-95f6-7462e95badd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.207899 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176414a-b811-4c2f-95f6-7462e95badd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.208174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176414a-b811-4c2f-95f6-7462e95badd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.208820 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176414a-b811-4c2f-95f6-7462e95badd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.210423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176414a-b811-4c2f-95f6-7462e95badd7 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.227179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1276/2564] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:29.231774 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.241925 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93807-ee7f-4c41-98bd-79df74539ff5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.247001 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.247678 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.247956 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.248226 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] PATH_INFO: `/v3/projects/3eaa14c845ca4c75ae66aab6d06748ce/users/7221b75f71fb44e89b4c180b1dce0837/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.262321 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eaa14c845ca4c75ae66aab6d06748ce, user_id=7221b75f71fb44e89b4c180b1dce0837, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.264960 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.277602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1289/2565] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:29 2022] PUT /identity/v3/projects/3eaa14c845ca4c75ae66aab6d06748ce/users/7221b75f71fb44e89b4c180b1dce0837/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:29.287926 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9bf50-1b00-43b0-8895-ee7f59e63e35 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.288210 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9bf50-1b00-43b0-8895-ee7f59e63e35 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.288481 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9bf50-1b00-43b0-8895-ee7f59e63e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.316580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-7eb9bf50-1b00-43b0-8895-ee7f59e63e35 None None] MFA Rules not processed for user `7221b75f71fb44e89b4c180b1dce0837`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:29.317780 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7eb9bf50-1b00-43b0-8895-ee7f59e63e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:29.346831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:29.381690 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1277/2566] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:29.414502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.416211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:29.493794 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bad61-dec3-4462-8d1b-e8d7e2a9f2f4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.498180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4568eb4-b1c3-4fba-9522-a7b3193cfb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.498787 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568eb4-b1c3-4fba-9522-a7b3193cfb5b service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.499068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568eb4-b1c3-4fba-9522-a7b3193cfb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.499371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4568eb4-b1c3-4fba-9522-a7b3193cfb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.507621 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4568eb4-b1c3-4fba-9522-a7b3193cfb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.509068 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4568eb4-b1c3-4fba-9522-a7b3193cfb5b service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.517991 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1290/2567] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:29.533818 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9bf50-1b00-43b0-8895-ee7f59e63e35 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.595747 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9bf50-1b00-43b0-8895-ee7f59e63e35 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.600367 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.600992 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.601274 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.601545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] PATH_INFO: `/v3/users/7221b75f71fb44e89b4c180b1dce0837` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.602682 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7221b75f71fb44e89b4c180b1dce0837)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.604662 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.650021 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7221b75f71fb44e89b4c180b1dce0837'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:29.650714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7221b75f71fb44e89b4c180b1dce0837'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:29.658420 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7221b75f71fb44e89b4c180b1dce0837'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:29.665174 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7221b75f71fb44e89b4c180b1dce0837'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:29.677791 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7221b75f71fb44e89b4c180b1dce0837'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:29.683589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1278/2568] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:29 2022] DELETE /identity/v3/users/7221b75f71fb44e89b4c180b1dce0837 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:29.688093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.688385 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.688668 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.707562 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:29.708786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:29.720950 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:29.768414 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1291/2569] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:29.778744 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:29.780290 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:29.836303 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a088e-2514-4231-b1ed-919ae1655778 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:29.840545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff801b-0ebc-4ea3-80b3-ded366d753d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:29.841146 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff801b-0ebc-4ea3-80b3-ded366d753d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:29.841423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff801b-0ebc-4ea3-80b3-ded366d753d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:29.841694 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff801b-0ebc-4ea3-80b3-ded366d753d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:29.847503 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:29.852446 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff801b-0ebc-4ea3-80b3-ded366d753d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:29.854752 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff801b-0ebc-4ea3-80b3-ded366d753d2 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:29.865326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1279/2570] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:32:30.150688 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.153007 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:30.166129 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7adce-940a-4e2a-8926-7479e9f6ab31 None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.171568 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.172529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.173046 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.173605 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] PATH_INFO: `/v3/projects/3eaa14c845ca4c75ae66aab6d06748ce` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.175099 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eaa14c845ca4c75ae66aab6d06748ce)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.177246 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.231522 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eaa14c845ca4c75ae66aab6d06748ce', 'request_id': 'req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:30.238200 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eaa14c845ca4c75ae66aab6d06748ce', 'request_id': 'req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:30.244255 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eaa14c845ca4c75ae66aab6d06748ce', 'request_id': 'req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:30.256903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] The token cache is being invalidate because project 3eaa14c845ca4c75ae66aab6d06748ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81348) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:30.257195 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:30.257841 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-8af1ad55-2d2a-414d-ae3e-a6eb133913e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:30.259362 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1292/2571] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:30 2022] DELETE /identity/v3/projects/3eaa14c845ca4c75ae66aab6d06748ce => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:30.264934 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc403-8b67-4001-8a7f-a85da5b26346 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.265442 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc403-8b67-4001-8a7f-a85da5b26346 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.265545 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc403-8b67-4001-8a7f-a85da5b26346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.284599 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-32cbc403-8b67-4001-8a7f-a85da5b26346 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:30.285814 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-32cbc403-8b67-4001-8a7f-a85da5b26346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:30.344432 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1280/2572] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:30.352205 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73405808-609f-4506-8e08-f979daa201ce None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.352722 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73405808-609f-4506-8e08-f979daa201ce None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.352825 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73405808-609f-4506-8e08-f979daa201ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.373014 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-73405808-609f-4506-8e08-f979daa201ce None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:30.374224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-73405808-609f-4506-8e08-f979daa201ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:30.382308 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1293/2573] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:30.386393 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc403-8b67-4001-8a7f-a85da5b26346 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.396883 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc403-8b67-4001-8a7f-a85da5b26346 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.401795 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.402427 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.402707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.402977 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.403641 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 19 13:32:30.403947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.405532 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.417077 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1281/2574] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Oct 19 13:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 19 13:32:30.421520 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73405808-609f-4506-8e08-f979daa201ce None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.430615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73405808-609f-4506-8e08-f979daa201ce None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.435864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.436461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.436742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.437034 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.437648 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.439583 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.467262 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1294/2575] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:32:30 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:30.471360 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.481305 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11175d-7acc-4bfe-89e9-186d819af2b2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.538578 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.539212 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.539497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.539773 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.540414 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.542405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.563693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1282/2576] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:32:30 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:30.567826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.578283 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13249b-6f8c-4213-aba5-43a5829d9c84 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.583137 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.583740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.584024 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.584301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.584948 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.586543 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.597058 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1295/2577] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:30.600937 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.611286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b73d4-688c-42d2-bcb0-5730146ed700 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.615968 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9cf27-c57c-40cb-8c4e-14409d182875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.616551 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9cf27-c57c-40cb-8c4e-14409d182875 admin admin] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.616824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9cf27-c57c-40cb-8c4e-14409d182875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.617090 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9cf27-c57c-40cb-8c4e-14409d182875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.617769 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9cf27-c57c-40cb-8c4e-14409d182875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.619380 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9cf27-c57c-40cb-8c4e-14409d182875 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.629030 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1283/2578] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:30.632832 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.643189 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a635c-7c4a-41d4-99f4-1a5d463510c5 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.647847 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.648492 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.648773 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.649051 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] PATH_INFO: `/v3/projects/1cd96b3f72be455086cc015046727753/users/aa2a10df989c4aff9f758fd9d4636a34/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.664585 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd96b3f72be455086cc015046727753, user_id=aa2a10df989c4aff9f758fd9d4636a34, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.667561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.680419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1296/2579] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:30 2022] PUT /identity/v3/projects/1cd96b3f72be455086cc015046727753/users/aa2a10df989c4aff9f758fd9d4636a34/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:30.744066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e139d-a0b4-4312-a56a-aec9e4bb974d None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.744340 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e139d-a0b4-4312-a56a-aec9e4bb974d None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.744610 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e139d-a0b4-4312-a56a-aec9e4bb974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.772276 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-dd3e139d-a0b4-4312-a56a-aec9e4bb974d None None] MFA Rules not processed for user `aa2a10df989c4aff9f758fd9d4636a34`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:30.773663 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-dd3e139d-a0b4-4312-a56a-aec9e4bb974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:30.818776 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:30.837851 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1284/2580] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:30.842905 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.883140 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:30.906799 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d21f9-6868-4387-b4cc-f5a582eedfd8 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:30.911426 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:30.912030 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:30.912316 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:30.912589 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:30.913234 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:30.915176 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:30.941692 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1297/2581] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:32:30 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 19 13:32:30.945760 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e139d-a0b4-4312-a56a-aec9e4bb974d None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:30.957150 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e139d-a0b4-4312-a56a-aec9e4bb974d None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.015659 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.016264 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.016539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.016808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] PATH_INFO: `/v3/users` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.017433 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.019370 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.043504 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1285/2582] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:32:30 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:32:31.044504 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.055822 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f7957-d98f-4f9f-996e-cab50368c0a6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.061149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.062797 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.063871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.064601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.064890 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.065214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.065869 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.067506 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.075016 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cfa2f-7c1e-4eaa-9dfe-bff9d378e086 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.081946 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1298/2583] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:32:31.082111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.082111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.082111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.082111 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] PATH_INFO: `/v3/users/cc1f7b8bb1504e7dbefea44eab2e8be0` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.082445 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1f7b8bb1504e7dbefea44eab2e8be0)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.082881 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.083947 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.094505 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3e46-0393-4fe0-9587-8c0d56349d16 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.099231 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.099826 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.100130 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.100407 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.101041 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.102646 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.117163 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1299/2584] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 19 13:32:31.118252 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.128578 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e19d0a-6973-4624-94e1-76564a7c918e admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.132140 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1f7b8bb1504e7dbefea44eab2e8be0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.132810 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1f7b8bb1504e7dbefea44eab2e8be0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.133180 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71543b28-f0c6-4b64-9fd1-2ab3600f162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.133814 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71543b28-f0c6-4b64-9fd1-2ab3600f162c admin admin] REQUEST_METHOD: `PUT` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.134097 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71543b28-f0c6-4b64-9fd1-2ab3600f162c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.134370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71543b28-f0c6-4b64-9fd1-2ab3600f162c admin admin] PATH_INFO: `/v3/projects/07fbddfc5c3846b19e64b148d462934c/users/0ac0b3e3960b4295a88f678dd77fb573/roles/b0eca5323ad04e739e90f2372d36e579` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.140824 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1f7b8bb1504e7dbefea44eab2e8be0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.148086 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1f7b8bb1504e7dbefea44eab2e8be0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.151532 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71543b28-f0c6-4b64-9fd1-2ab3600f162c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fbddfc5c3846b19e64b148d462934c, user_id=0ac0b3e3960b4295a88f678dd77fb573, role_id=b0eca5323ad04e739e90f2372d36e579)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.154256 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71543b28-f0c6-4b64-9fd1-2ab3600f162c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.162048 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-bbf80beb-28ae-4d2e-acbd-8dc4fd513229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1f7b8bb1504e7dbefea44eab2e8be0'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.167676 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1300/2585] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:31 2022] PUT /identity/v3/projects/07fbddfc5c3846b19e64b148d462934c/users/0ac0b3e3960b4295a88f678dd77fb573/roles/b0eca5323ad04e739e90f2372d36e579 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:31.178349 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.178602 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.178995 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.179762 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1286/2586] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:31 2022] DELETE /identity/v3/users/cc1f7b8bb1504e7dbefea44eab2e8be0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:31.184399 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.184685 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.184953 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.204188 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:31.205388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.209093 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] MFA Rules not processed for user `0ac0b3e3960b4295a88f678dd77fb573`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:31.210340 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.249438 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:31.265863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1287/2587] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:32:31.275753 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.276341 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1301/2588] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 19 13:32:31.277300 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.280488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.281842 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.295198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47ae25-d830-49d9-963c-826366cf0dde None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.300045 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.300636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.300929 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.301183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.301849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.303788 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.334411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1302/2589] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Oct 19 13:32:31 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:32:31.335510 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.336412 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c67caa-47be-493d-8192-97fc6a0c4867 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.381879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:31.386454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.387642 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.387961 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.388190 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.401133 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d46b-1367-4449-aa49-eaf715a2cf82 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.406288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.406894 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.407211 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.407483 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] PATH_INFO: `/v3/users` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.408113 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.410019 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.432166 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1303/2590] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Oct 19 13:32:31 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 19 13:32:31.436146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.446300 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9d40-e643-426d-931c-1fab7ee3a347 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.451590 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.452153 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.452274 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.452472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.452736 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.453371 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.453604 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.454955 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.464158 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1288/2591] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:31.465732 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1304/2592] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:32:31.469645 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.479309 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13885b-aedf-489e-9d07-744df8ee8af3 service neutron] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.484066 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.484856 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.485201 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.485539 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] PATH_INFO: `/v3/projects/170fe910d2b4493aa302ae8d0e1b409d/users/2bcbd7bee05642958c4aba9b5f2520f7/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.500742 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=170fe910d2b4493aa302ae8d0e1b409d, user_id=2bcbd7bee05642958c4aba9b5f2520f7, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.503341 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.517169 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1289/2593] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:31 2022] PUT /identity/v3/projects/170fe910d2b4493aa302ae8d0e1b409d/users/2bcbd7bee05642958c4aba9b5f2520f7/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:31.521394 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.538198 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fd91b-26ff-408d-ae24-94206c2a71c6 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.616146 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc8cc-194b-48e7-85bd-8fc3ffdc0b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.616926 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc8cc-194b-48e7-85bd-8fc3ffdc0b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.617207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc8cc-194b-48e7-85bd-8fc3ffdc0b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.617477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc8cc-194b-48e7-85bd-8fc3ffdc0b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.618114 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc8cc-194b-48e7-85bd-8fc3ffdc0b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.619745 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc8cc-194b-48e7-85bd-8fc3ffdc0b26 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.630238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1305/2594] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Oct 19 13:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 19 13:32:31.634358 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.645625 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eed5e-fa49-41c9-b3c1-2fe6fec4cb5b admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.650808 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.651500 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] REQUEST_METHOD: `PUT` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.651785 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.652059 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] PATH_INFO: `/v3/projects/170fe910d2b4493aa302ae8d0e1b409d/users/2bcbd7bee05642958c4aba9b5f2520f7/roles/9f876a46b1814b3dbf30b83f8dde7ee9` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.654630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170fe910d2b4493aa302ae8d0e1b409d, user_id=2bcbd7bee05642958c4aba9b5f2520f7, role_id=9f876a46b1814b3dbf30b83f8dde7ee9)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.657373 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.667932 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1290/2595] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Oct 19 13:32:31 2022] PUT /identity/v3/projects/170fe910d2b4493aa302ae8d0e1b409d/users/2bcbd7bee05642958c4aba9b5f2520f7/roles/9f876a46b1814b3dbf30b83f8dde7ee9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:31.679584 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.679871 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.680150 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.708372 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] MFA Rules not processed for user `2bcbd7bee05642958c4aba9b5f2520f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:31.709600 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.771410 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.773834 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.787249 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1306/2596] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:31.795595 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:31.797431 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.803444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:31.846636 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:31.853617 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8099dde-3f79-4c0f-9e0c-187282f0e959 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.858515 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728f84e-830a-4e26-8628-00992e1fd9fb None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:31.859286 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.859920 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.860194 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.860465 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] PATH_INFO: `/v3/projects/09000d396f3645e1b9e52e323a8811e5` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.861657 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09000d396f3645e1b9e52e323a8811e5)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.862185 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:31.862789 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:31.863071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:31.863370 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:31.863589 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.865108 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:31.912771 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09000d396f3645e1b9e52e323a8811e5', 'request_id': 'req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.919405 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09000d396f3645e1b9e52e323a8811e5', 'request_id': 'req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.926817 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:31.927907 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09000d396f3645e1b9e52e323a8811e5', 'request_id': 'req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.928424 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:31.938091 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1307/2597] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 19 13:32:31.939800 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] The token cache is being invalidate because project 09000d396f3645e1b9e52e323a8811e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:31.940100 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.940758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:31.942419 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1291/2598] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:31 2022] DELETE /identity/v3/projects/09000d396f3645e1b9e52e323a8811e5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:32:33.471810 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:33.473242 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:33.484182 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d64616-703b-4640-8860-12e1d5cd7082 service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:33.533303 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:33.533903 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:33.534183 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:33.534455 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:33.536272 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:33.593767 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:33.595221 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:33.603941 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1308/2599] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:34.121198 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:34.122630 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:34.135613 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed05d-4df3-46cd-b388-b7dcb237d20e admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:34.139497 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6afa86-0818-47d5-94e3-5244cdf8512b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908ecd4f59ba49e7bec2a57700bdf957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:34.140192 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6afa86-0818-47d5-94e3-5244cdf8512b service cinder] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:34.140440 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6afa86-0818-47d5-94e3-5244cdf8512b service cinder] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:34.140749 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6afa86-0818-47d5-94e3-5244cdf8512b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:34.142547 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-2d6afa86-0818-47d5-94e3-5244cdf8512b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:34.207415 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6afa86-0818-47d5-94e3-5244cdf8512b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:34.208908 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6afa86-0818-47d5-94e3-5244cdf8512b service cinder] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:34.218909 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1292/2600] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:38.077630 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:38.079011 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:38.132801 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=100 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:38.146642 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172403fe-fcf9-4ddf-81d8-0eec18ca1ada service cinder] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:38.151289 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:38.152549 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:38.152855 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:38.153127 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] PATH_INFO: `/v3/users/aa2a10df989c4aff9f758fd9d4636a34` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:38.154248 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2a10df989c4aff9f758fd9d4636a34)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:38.156207 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:38.203061 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2a10df989c4aff9f758fd9d4636a34'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.203754 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2a10df989c4aff9f758fd9d4636a34'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.210699 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2a10df989c4aff9f758fd9d4636a34'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.223063 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2a10df989c4aff9f758fd9d4636a34'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.223719 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2a10df989c4aff9f758fd9d4636a34'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.236456 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1309/2601] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:38 2022] DELETE /identity/v3/users/aa2a10df989c4aff9f758fd9d4636a34 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:38.240981 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] REQUEST_METHOD: `POST` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:38.241482 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:38.241618 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:38.260556 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.auth.core [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] MFA Rules not processed for user `84e8dce821b046efa98901e318ae5922`. Rule list: `[]` (Enabled: `True`). {{(pid=81347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:32:38.262318 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:38.305052 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:38.324945 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1293/2602] 10.222.0.46 () {58 vars in 958 bytes} [Wed Oct 19 13:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:32:38.334615 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:38.336132 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:38.392346 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0bffa-7b21-4f32-b9d7-17b9e9fc8cfa admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:38.396017 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0ffc12a2fe49938b8a5ab56cd9721f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:38.396617 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:38.396897 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:38.397172 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:38.406821 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:38.408279 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:38.417576 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1310/2603] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:32:38.679282 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:38.680813 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:38.695166 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa1f-e8cf-4c9e-9229-fa2726d96ff8 None None] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:38.701379 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:38.702388 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:38.702837 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:38.703294 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] PATH_INFO: `/v3/projects/1cd96b3f72be455086cc015046727753` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:38.704693 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd96b3f72be455086cc015046727753)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:38.706863 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:38.753519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd96b3f72be455086cc015046727753', 'request_id': 'req-c2399e90-ec6b-4707-b5d0-2714f65b4eac'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.760378 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd96b3f72be455086cc015046727753', 'request_id': 'req-c2399e90-ec6b-4707-b5d0-2714f65b4eac'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.770292 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd96b3f72be455086cc015046727753', 'request_id': 'req-c2399e90-ec6b-4707-b5d0-2714f65b4eac'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.781679 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] The token cache is being invalidate because project 1cd96b3f72be455086cc015046727753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:38.781972 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.782614 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.784179 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1294/2604] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:38 2022] DELETE /identity/v3/projects/1cd96b3f72be455086cc015046727753 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:38.788125 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:38.797938 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65585-50f0-4bb1-816e-d39de10507a3 service neutron] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:38.853849 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:38.854477 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:38.854760 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:38.855037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] PATH_INFO: `/v3/users/0ac0b3e3960b4295a88f678dd77fb573` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:38.856196 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac0b3e3960b4295a88f678dd77fb573)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:38.858107 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:38.874037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:38.903490 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac0b3e3960b4295a88f678dd77fb573'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.904148 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac0b3e3960b4295a88f678dd77fb573'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.910909 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac0b3e3960b4295a88f678dd77fb573'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.923843 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac0b3e3960b4295a88f678dd77fb573'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.924419 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac0b3e3960b4295a88f678dd77fb573'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:38.937710 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1311/2605] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:38 2022] DELETE /identity/v3/users/0ac0b3e3960b4295a88f678dd77fb573 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:39.208319 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:39.209978 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:39.222798 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399e90-ec6b-4707-b5d0-2714f65b4eac admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:39.282044 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:39.282758 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:39.282939 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:39.283246 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] PATH_INFO: `/v3/projects/07fbddfc5c3846b19e64b148d462934c` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:39.284458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fbddfc5c3846b19e64b148d462934c)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:39.286335 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:39.331512 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fbddfc5c3846b19e64b148d462934c', 'request_id': 'req-96d54146-7af7-41b4-b672-418365878e19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.337548 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fbddfc5c3846b19e64b148d462934c', 'request_id': 'req-96d54146-7af7-41b4-b672-418365878e19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.345261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fbddfc5c3846b19e64b148d462934c', 'request_id': 'req-96d54146-7af7-41b4-b672-418365878e19'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.351812 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:39.357189 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] The token cache is being invalidate because project 07fbddfc5c3846b19e64b148d462934c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:39.357714 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.358488 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.360472 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1295/2606] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:39 2022] DELETE /identity/v3/projects/07fbddfc5c3846b19e64b148d462934c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:39.364479 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:39.365864 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:39.378353 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03463762-5a10-45e3-b76d-099d0fc33db7 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:39.433285 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:39.433910 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:39.434187 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:39.434459 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] PATH_INFO: `/v3/users/2bcbd7bee05642958c4aba9b5f2520f7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:39.435586 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bcbd7bee05642958c4aba9b5f2520f7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:39.437475 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:39.482614 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bcbd7bee05642958c4aba9b5f2520f7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.483280 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bcbd7bee05642958c4aba9b5f2520f7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.490153 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bcbd7bee05642958c4aba9b5f2520f7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.501861 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bcbd7bee05642958c4aba9b5f2520f7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.502471 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bcbd7bee05642958c4aba9b5f2520f7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.515038 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1312/2607] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:32:39 2022] DELETE /identity/v3/users/2bcbd7bee05642958c4aba9b5f2520f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:39.774450 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:32:39.776026 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:32:39.793143 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d54146-7af7-41b4-b672-418365878e19 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:32:39.849829 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:32:39.850458 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:32:39.850740 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:32:39.851132 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] PATH_INFO: `/v3/projects/170fe910d2b4493aa302ae8d0e1b409d` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:32:39.852261 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170fe910d2b4493aa302ae8d0e1b409d)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:32:39.854170 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:32:39.901892 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170fe910d2b4493aa302ae8d0e1b409d', 'request_id': 'req-39a0f46f-34d9-4b58-8b40-6066d3f5d537'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.907990 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170fe910d2b4493aa302ae8d0e1b409d', 'request_id': 'req-39a0f46f-34d9-4b58-8b40-6066d3f5d537'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.915310 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170fe910d2b4493aa302ae8d0e1b409d', 'request_id': 'req-39a0f46f-34d9-4b58-8b40-6066d3f5d537'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.926707 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] The token cache is being invalidate because project 170fe910d2b4493aa302ae8d0e1b409d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:32:39.927000 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.927673 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:32:39.929142 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1296/2608] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:32:39 2022] DELETE /identity/v3/projects/170fe910d2b4493aa302ae8d0e1b409d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:32:49.511535 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=19,keystone:SELECT=73,keystone:INSERT=2 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:49.923535 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:16.491398 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:33:16.492824 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:16.581047 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdcf44-1928-4aa5-b590-d77421925437 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:33:16.642673 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:33:16.643314 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:16.643601 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:16.643878 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:16.645667 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:16.656882 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:33:16.658508 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:33:16.668539 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1313/2609] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:33:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:33:26.664212 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=67 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:31.840344 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:33:31.841473 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:31.963596 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0f46f-34d9-4b58-8b40-6066d3f5d537 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:33:31.972155 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1433a2c778346a09a10845139967c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:33:31.972868 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:31.973072 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:31.973324 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:31.975118 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:31.988597 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:33:31.990217 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:33:32.003866 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1297/2610] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:33:41.998337 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=46 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:42.955608 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:33:42.957220 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:43.037797 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81540658-b08d-4015-86ae-1dd39ccb0bcc service placement] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:33:43.042813 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:33:43.043502 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:43.043786 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:43.044461 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] PATH_INFO: `/v3/users/854549631d1648bcaa0e8bc6bceea217` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:43.045571 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854549631d1648bcaa0e8bc6bceea217)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:33:43.048105 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:33:43.097592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854549631d1648bcaa0e8bc6bceea217'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.098236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854549631d1648bcaa0e8bc6bceea217'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.105214 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854549631d1648bcaa0e8bc6bceea217'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.117561 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854549631d1648bcaa0e8bc6bceea217'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.118236 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854549631d1648bcaa0e8bc6bceea217'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.130940 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1314/2611] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:33:42 2022] DELETE /identity/v3/users/854549631d1648bcaa0e8bc6bceea217 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:33:43.303149 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:33:43.314516 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63ea72-f77e-43ad-b8f9-e2ede1897ec1 service nova] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:33:43.371005 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:33:43.371660 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:43.371936 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:43.372205 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] PATH_INFO: `/v3/projects/986e831265a94708933e7633d37492b8` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:43.373332 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986e831265a94708933e7633d37492b8)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:33:43.375831 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:33:43.421692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986e831265a94708933e7633d37492b8', 'request_id': 'req-e0c06868-84e7-48ab-8779-2cec29583da2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.427998 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986e831265a94708933e7633d37492b8', 'request_id': 'req-e0c06868-84e7-48ab-8779-2cec29583da2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.435231 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986e831265a94708933e7633d37492b8', 'request_id': 'req-e0c06868-84e7-48ab-8779-2cec29583da2'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.445872 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] The token cache is being invalidate because project 986e831265a94708933e7633d37492b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:33:43.446162 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.446784 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.448259 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1298/2612] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:33:43 2022] DELETE /identity/v3/projects/986e831265a94708933e7633d37492b8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:33:43.452349 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:33:43.453742 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:43.466911 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76062ae7-02a9-4954-b832-14bdd522fe72 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:33:43.522472 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:33:43.523123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:43.523406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:43.523679 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] PATH_INFO: `/v3/users/d4f386c6f13f4cba8bf6344160617dfd` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:43.524805 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f386c6f13f4cba8bf6344160617dfd)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:33:43.526918 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:33:43.548879 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:43.574850 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f386c6f13f4cba8bf6344160617dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.575529 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f386c6f13f4cba8bf6344160617dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.584376 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f386c6f13f4cba8bf6344160617dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.596888 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f386c6f13f4cba8bf6344160617dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.597592 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-b0b6258e-79dd-4160-8c41-4410e8e6e413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f386c6f13f4cba8bf6344160617dfd'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.611482 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1315/2613] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:33:43 2022] DELETE /identity/v3/users/d4f386c6f13f4cba8bf6344160617dfd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:33:43.788423 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:33:43.789858 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:43.809786 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06868-84e7-48ab-8779-2cec29583da2 admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:33:43.866298 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:33:43.866921 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:43.867234 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:43.867507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] PATH_INFO: `/v3/projects/74464e32dca7451790cf8f0e3563ca68` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:43.868609 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=74464e32dca7451790cf8f0e3563ca68)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:33:43.870506 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:33:43.903406 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:43.917521 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74464e32dca7451790cf8f0e3563ca68', 'request_id': 'req-f486e0d3-1fea-4f3a-b032-7879aed700fb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.924562 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74464e32dca7451790cf8f0e3563ca68', 'request_id': 'req-f486e0d3-1fea-4f3a-b032-7879aed700fb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.931507 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74464e32dca7451790cf8f0e3563ca68', 'request_id': 'req-f486e0d3-1fea-4f3a-b032-7879aed700fb'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.942131 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] The token cache is being invalidate because project 74464e32dca7451790cf8f0e3563ca68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:33:43.942421 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.943043 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:33:43.944530 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1299/2614] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:33:43 2022] DELETE /identity/v3/projects/74464e32dca7451790cf8f0e3563ca68 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:33:53.606844 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:53.939161 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:55.413111 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] REQUEST_METHOD: `POST` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:55.413574 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:55.413698 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:55.444203 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.auth.core [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] MFA Rules not processed for user `e5328d51705c49b2a44c47eabaa89a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 19 13:33:55.445416 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:55.499655 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1316/2615] 10.222.0.46 () {58 vars in 967 bytes} [Wed Oct 19 13:33:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 19 13:33:55.540238 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:33:55.541692 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:33:55.610454 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e0d3-1fea-4f3a-b032-7879aed700fb admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:33:55.615402 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d5405a020ae4d61810ae01872cf325b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:33:55.616006 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] REQUEST_METHOD: `GET` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:33:55.616291 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:33:55.616561 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:33:55.624450 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:33:55.626559 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:33:55.634444 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1300/2616] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Oct 19 13:33:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 19 13:34:01.943271 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:34:01.945227 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:34:02.020488 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc9fd7-ca97-4c56-afd0-06e08bb2ba9f None None] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:34:02.025037 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:34:02.025683 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:34:02.025962 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:34:02.026232 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] PATH_INFO: `/v3/users/b320199614cf4d89b692badd01a97db5` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:34:02.027433 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b320199614cf4d89b692badd01a97db5)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:34:02.029347 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:34:02.076238 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b320199614cf4d89b692badd01a97db5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.076834 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b320199614cf4d89b692badd01a97db5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.084388 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b320199614cf4d89b692badd01a97db5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.096750 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b320199614cf4d89b692badd01a97db5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.097392 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b320199614cf4d89b692badd01a97db5'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.109954 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1317/2617] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:34:01 2022] DELETE /identity/v3/users/b320199614cf4d89b692badd01a97db5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:34:02.281710 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:34:02.293254 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bf46-8648-43ad-94d4-831be746ee43 service swift] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:34:02.350917 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:34:02.351579 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:34:02.351855 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:34:02.352128 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] PATH_INFO: `/v3/projects/9235714ca09747a58275e32f557befb3` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:34:02.353237 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9235714ca09747a58275e32f557befb3)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:34:02.355171 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:34:02.400767 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9235714ca09747a58275e32f557befb3', 'request_id': 'req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.406849 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9235714ca09747a58275e32f557befb3', 'request_id': 'req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.414417 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9235714ca09747a58275e32f557befb3', 'request_id': 'req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.425313 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] The token cache is being invalidate because project 9235714ca09747a58275e32f557befb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:34:02.425606 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.426240 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.427764 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1301/2618] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:34:02 2022] DELETE /identity/v3/projects/9235714ca09747a58275e32f557befb3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:34:02.431833 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:34:02.433224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:34:02.446588 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83f3d-a32e-410e-8c5d-4359cd33db0c admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:34:02.458224 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:02.502740 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:34:02.503406 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:34:02.503686 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:34:02.503957 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] PATH_INFO: `/v3/users/678c86c0225d4a4a9de072dc30709de7` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:34:02.505071 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678c86c0225d4a4a9de072dc30709de7)` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:34:02.506972 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:34:02.549916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678c86c0225d4a4a9de072dc30709de7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.550564 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678c86c0225d4a4a9de072dc30709de7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.557288 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678c86c0225d4a4a9de072dc30709de7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.569360 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678c86c0225d4a4a9de072dc30709de7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.569988 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.notifications [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678c86c0225d4a4a9de072dc30709de7'} {{(pid=81348) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.582411 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1318/2619] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Oct 19 13:34:02 2022] DELETE /identity/v3/users/678c86c0225d4a4a9de072dc30709de7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 19 13:34:02.754712 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Authenticating user token {{(pid=81347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:34:02.756181 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.fernet_utils [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:34:02.770754 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beaf6a-9c98-4fd1-ab0b-1f4dbb802c3f admin admin] Validating token access rules against request {{(pid=81347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:34:02.787563 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:02.829887 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84e8dce821b046efa98901e318ae5922', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efe3aef313a94867b11cab52bd11b924', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:34:02.830519 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:34:02.830802 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:34:02.831070 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] PATH_INFO: `/v3/projects/496f711c68f04ec0b707f294f6ba23ef` {{(pid=81347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:34:02.832225 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496f711c68f04ec0b707f294f6ba23ef)` {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:34:02.834129 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] RBAC: Authorization granted {{(pid=81347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:34:02.880316 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496f711c68f04ec0b707f294f6ba23ef', 'request_id': 'req-88b903ee-2956-41a4-a5c2-8c93444485c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.886580 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496f711c68f04ec0b707f294f6ba23ef', 'request_id': 'req-88b903ee-2956-41a4-a5c2-8c93444485c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.894658 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496f711c68f04ec0b707f294f6ba23ef', 'request_id': 'req-88b903ee-2956-41a4-a5c2-8c93444485c3'} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.905326 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] The token cache is being invalidate because project 496f711c68f04ec0b707f294f6ba23ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 19 13:34:02.905649 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.906280 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG keystone.notifications [None req-88b903ee-2956-41a4-a5c2-8c93444485c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 19 13:34:02.907803 dv-cinder-861883-1-smb devstack@keystone.service[81347]: [pid: 81347|app: 0|req: 1302/2620] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Oct 19 13:34:02 2022] DELETE /identity/v3/projects/496f711c68f04ec0b707f294f6ba23ef => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 19 13:34:12.579123 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:12.901880 dv-cinder-861883-1-smb devstack@keystone.service[81347]: DEBUG dbcounter [-] [81347] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:20.520452 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Authenticating user token {{(pid=81348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 19 13:38:20.521867 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:38:20.591301 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e74fbf-1be3-4171-abc7-0b6bc5406ef4 admin admin] Validating token access rules against request {{(pid=81348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 19 13:38:20.650724 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bf831-2f91-4483-998e-123825ac2e37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b620598f694d4bae6a96822fc7e843', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0415b19faa8341d4ac0f7d43948f0ad1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 19 13:38:20.651364 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bf831-2f91-4483-998e-123825ac2e37 service placement] REQUEST_METHOD: `GET` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 19 13:38:20.651647 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bf831-2f91-4483-998e-123825ac2e37 service placement] SCRIPT_NAME: `/identity` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 19 13:38:20.651916 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bf831-2f91-4483-998e-123825ac2e37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 19 13:38:20.653650 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.fernet_utils [None req-296bf831-2f91-4483-998e-123825ac2e37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 19 13:38:20.664640 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bf831-2f91-4483-998e-123825ac2e37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 19 13:38:20.666839 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bf831-2f91-4483-998e-123825ac2e37 service placement] RBAC: Authorization granted {{(pid=81348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 19 13:38:20.676806 dv-cinder-861883-1-smb devstack@keystone.service[81348]: [pid: 81348|app: 0|req: 1319/2621] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Oct 19 13:38:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 19 13:38:30.672651 dv-cinder-861883-1-smb devstack@keystone.service[81348]: DEBUG dbcounter [-] [81348] Writing DB stats keystone:SELECT=58 {{(pid=81348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}